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ABSTRACT 

A two-phased research project sought to develop 
instructional sequences for computer-assisted technical training 
materials which would reduce student learning time. In Phase I, 
technical concepts embedded in training materials were subjected to 
Inscal Hultidimensional Scaling to determine their complexity and 
relationships; the materials were then revised. Pictorial analogues 
of verbal materials and tests were developed and the added measures 
of 1) cloze Comprehension r 2) Concept Cloze Comprehension^ and 3) 
Post^Instructional concept Similarity Ratings were used. Analysis of 
performance measures indicated that the Inscal technique aided the 
definition of information complexity of technical material, the 
development of sequences of conceptSr and the creation of an index of 
inter-^rater consensus. Parameter values selected for the Phase II 
experiment included: 1) determination of presentation rate; 2) 
selection of performance measures; 3) refinement of presentation and 
test modes; 4) selection of three instructional sequences; and 5) 
inclusion of individual difference measures to assess variance in 
student aptitude. (Author/PB) 
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Additional measures included standard Cloze, concept cloze, and concept 
similarity measures of student comprehension* Conclusions from three Phase I 
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experiment were: (l) technical material differed significantly in difficulty 
level on five performance measures* Two difficulty levels were selected for 
Phase II experimentation » (2) h5 sec presentation rate of stimulus materials 
in print versus pictorial modes led to median performance levels, thus avoiding 
ceiling" and "floor" effects associated with other presentation rates, and 
(3) four instructional sequences were derived from Inscal methodology based 
upon several sequencing principles. Two sequences in addition to the unrevised 
Air Force sequence were selected for inclusion in the Phase II main experiment. 
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PROBLEM . One goal of technical training is to minimize the time required 
for students to acquire task-related information and skills. To this 
end, task analyses are used to identify and formulate relevant 
instructional content. However, the determination and validation of 
performance-facilitating instructional sequences has been an area 
dominated by intuitive as opposed to scientific approaches. Within 
computer-based instructional systems, the impact of instructional 
sequences upon student time to attain instructional objectives is 
clearly important. Lacking reliable and valid information concerning 
effective instructional sequences, the potential of computer technology 
to expedite student progress is undxily limited. The objective of the 
present 2-phased research project is to reduce this knowledge gap by: 

(1) a review and synthesis of factors related to information sequencing, 

(2) application of developments in measurement technology for the 
purpose of objectively measuring and developing improved instructional 
sequences, and (3) conducting pilot research to determine parameter 
values for Inclusion in the Phase II investigation of Air Force teclmical 
information sequences. 

APPROACH . Technical materials, ranging in difficulty level, were 
selected frcan three, different Air Force technical training courses. 
Inscal mxxltidimensional scaling methodology was applied to the course 
material and to concept simileirity^ ratings obtained from technical 
experts within the academic and military ccmmunities. 

Pictorial analogs of the verbal instructional material , contained within 
the original Air Force material were developed. Similarly, non-verbal 
pictorieLL multiple choice tests were developed to correspond to the • 
verbal multiple choice tests of each of the three instructional packages. 
Additional measures of student performance include: (l) Cloze Comprebension, 
(2) Concept Cloze Comprehension, and (3) Post-Instructional Concept 
Similarity Ratings. 

In addition to the origineuL Air Force sequence, computer algoritims were 
developed to provide two different instructional sequences for each 
instructional package. Instructional information sequences were presented 
to subjects in either pictorial or printed form and performance measures 
gathered. 

FINDINGS > Inscal multidimensional scaling was shown to be of value with 
respect to (l) defining the information complexity of technical material, 

(2) developing sequences of key concepts within technical material, and 

(3) providing an index of expert inter-rater consensus. Wlien the Inscal 
measure is obtained after student exposure to the material, Inscal 
provides an indication of the correspondence between experts' understanding 
of concept interrelationships. Pilot Study I reported correlations 
ranging from .1+2 to .hk between student and expert judgments gathered 

from pictorial and verbal presentation modes at a J+5-'Second presentation 
rate. 
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Pilot Study II indicated that the three Air Force instructional packages 
differed significantly in difficulty as defined by perf orjnance on four 
dependent measures. Various principles of sequencing were employed in 
a third pilot study to probe and select instructional sequences likely 
to influence student performance. Though Pilot Study III revealed no 
statistically significant performance differences due to four 
instructional sequences, sequences based upon certain concept proximity 
principles appeared premising and thus, will be included in the Phase 
II main experiment. 

Critical literature analyses reported herein indicate that the superiority 
of branching over non-branching sequences may be due to a methodological 
artifact. Failure to control for equal numbers of frames presented 
under both branching and non-brcuiching sequences has t; jiceuLly resxxlted 
in fever frames presented to students under the branching condition. 
Hence, the number of frames as opposed to the branching sequence per se 
may be responsible for performance differences. Indeed, most branching 
studies typically demonstrate no difference in achievement between 
treatments, however, mean time savings to conplete instruction are 
usually associated with the branching condition. 

CONCLUSIONS . Inscal has been shown to be an objective and versatile 
measurement methodology • As a tool for defining and sequencing concept 
interrelationships, Inscal offers potential payoff in developing sequences 
tailored to the individual student in computer-based settings. Employed 
as a post-instructional measure of concept interrelationships, Inscal 
provides an index of congruence between expert and student understanding 
of such interrelationships. 

Parameter values selected for inclusion in the Phase II main experiment 
included (l) determination of presentation rate, (2) selection of 
multi-criteria performance measures, (3) refinement of pictorial and 
print presentation modes to include pictorial and print multiple choice 
tests, (1+) selection of three instructional sequences, and (5) inclusion 
of individual difference measures to assess variance in student aptitude. 
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CHAPTER I 

STIMULUS SEQUENCE: A REVIEW AND SYNTHESIvS 



Introduction 



^ This section of the report is designed to acquaint* 
the reader with current issues and recent scientific 
evidence {primarily since 1965) related to the impact of 
certain variables upon the design and cTevelopment of 
effective instructional sequences. 

Prom a practical standpoint, technological support 
for education is further advanced than is the corres- 
ponding body of knowledge and principles which would 
allow educators to capitalize fully on technology's 
potential. Hence, important questions such as, "What 
do you need to know to design a cost-effective instruc- 
ts se*2uence to optimize individual student learning?" 
or How do you know the selected sequence is the best 
alternative sequence for the student?" are no longer 
merely academic questions. Applied technology and its 
future role in instruction depend in part on saientifio 
answers to these questions. In a sense, the technological 
horse is pressing at the starting gate, waiting for its 
scientific rider to catch up before its full potential 
can be released. 

To facilitate reader acquaintance with the issues 
involved, this review will provide the following format: 
(1) specify the issue, (2) identify the variables 
relevant to the study of sequencing, (3) provide an 
assessment of the adequacy of research supporting 
conclusions about each variable, and (4) recommend 
research to obtain scientific data in support of' more 
optimal instructional sequencing. The following maior 
topics will be discussed sequentially in this report: 

Stimulus Seguencings An Overview 
Impact of Sequence Manipulation on Performance 
Student Versus Instructor Determined Sequences 
Principles of Stimulus Sequencing 
Interaction of Individual Difference Variables 
with Stimulus Sequencing 
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Sequencing of Supplementary Insfcructional Material 
Describing the Information Structure 
Recommended Directions for Pviture Research • 

Stimulus Sequencing i An Overview 

TJie major issue which has important economic over- 
tones in addition to the design goal of effective 
instructional sequences is, ''Are all sequences equally 
, effective, or are some sequences more performance- 
effective than others?" 

Instructional materials must be presented in some 
sequence/ and indeed this is usually one of the first 
problems the instructor encounters when he begins to plan 
a course of instruction. Most bodies of information 
are not clearly and simply organized into a single 
sequence « Rather there are interlocking relationships 
such that any particular concept must be considered in 
relationship to several others. Yet language permits 
the statement of such relationships only one at a time; 
consequently, some decision must always be made as to 
which relationship will be stated first. 

The importance of the appropriate sequencing of 
instructional materials is generally recognized by 
educators and has led to a considereible amount of 
planning effort devoted to^ the choice of appropriate 
sequencing. In the school curriculum it is necessary 
to order the presentation of instruction over grade 
levels. Generally such an ordering is fairly obvious. 
Within each grade level there is again a sequencing for 
the school year and for a given semciSter. . Sequencing 
problems can be pursued downward to increasingly finer 
levels of detail. A single lecture or classroom session 
must in itself be sequenced, and indeed every single 
paragraph or sentence must be produced in a sequence, 
even though planning effort at this level may not be 
observed. 

This report will focus principally upon the sequenc- 
ing of relatively smali instructional units? unitis which 
might be presented in approximately one class hour. In 
this overview section we will explore: (1) the potential 
effects of content on sequencing, (2) the effects of 
extra-content vari^hleB, (3) methods for presienting 
sequences, and (4) methods for measuring the effectiveness 
of sequences. 



Effects of Content Properties on S equencing , , Pro- 
perties of instructional content may be expected to 
influence the effects of sequencing* For example, 
instruction on elementary characteristics of matter 
includes the concepts of atom, conductor, electron, and 
free electron • Electrons are components of atoms and 
the two concepts must be treated close together in the 
instructional sequence. Conductors are not directly 
related to atoms but must be linked by the intervening 
concept of fr^e ^Slectron, which explains how electrons 
can be available to move around and so conduct current. 
Such interrelationships seem to impose definite require- 
ments on the sequencing. 

Thus, sequencing becomes important because of 
interrelationships of concepts within an instructional 
unit. Such interrelationships presumably influence the 
effect of sequencing or influence the sequence chosen by 
the careful instructor, in either sense, uvidence to 
be reported later in this report indicates that content 
interrelationships are major considerations in the study 
of sequencing. 

The most general content factor influencing the 
sequence of instruction is that of independence or 
dependence of content. The domain of instructional 
materials may be divided into units containing essentially 
independent items and units composed of items which are 
dependent or interrelated. Materials with independent 
content are probably relatively rare in practical 
situations, although, they are not uncommonly used in 
psychological experiments, as in paired-associate 
learning. The use of such materials typically occurs 
in the learning of lists of unrelated words or objects. 
They may also be used in the learning of associations 
between previously unrelated terms such as the names of 
states and their associated capitols, or of resistors and 
their respective color codes. There seems no strong 
reason to expect that sequence effects would be of 
substantial importance with material consisting of 
independent content because each item can be learned 
separately, without reference to other items. 

Material cort^osed of independent content, however, 
is useful for studying the effects of order of presenta- 
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tion in isolation from pre-existing content relationships. 
Such effects are indeed found. The major effects identi- 
fied with such materials may be termed primacy and 
recency . Primacy denotes the observation that material 
which Is presented first in an instructional \anit is 
often the best remembered. Recency denotes the observa- 
tion that the most recently presented material is also 
among the best remembered. Both of these observations 
have some implication for the ordering of instructional 
material. For example r one might choose to present the 
most important material first/ to take advantage of the 
primacy effect. The recency effect r which is usually 
attributed to a short term memory phenomenon, is probcibly 
less important for determining the sequencing of instruc- 
tional material r but may have some substantial bearing 
upon such considerations as the timing of tests in . 
relation to the provision of encapsulated review, or the 
immediate linking of a recent concept to a related 
higher order concept. 

In general, however, unrelated or independent 
concepts probably have relatively little bearing upon 
the problem of sequencing material. Of substantially 
greater importance are materials which have strongly 
ixirerrelated concepts, and we turn to these in the 
following sections. 

Contents wi th temporal and spatial dependence . 
Instruction on how to perform some simple task, such as 
cleaning a weapon, often contains an inherent procedural 
chain. In other words, there is a predetermined order 
(temporal sequence) in which things are to be done. 
Such a temporal sequence provides a strongly indicated 
ordering for the presentation of instruction, it may 
be xioted that the ordering is not necessarily from first 
step to last; it could also be from last to first. But 
there seems little reason to expect any other substantial 
deviation from the indicated ordering. 

Other content areas may exhibit a spatial dependence. 
Teaching the location of objects on a map is a clear 
example of such a case. Spatial dependence involves at 
least two dimensions (e.g., the north-south and east- 
west dimensions) and so is less easily translated into 
a single clearly determined order. However, one could 
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use certain properties of the spatial relations, such 
as the proximity of objects to determine a reasonable 
order of presentation. 

Complex interdependencies of content . Complex 
interdependencies between concepts may be identified 
both in instruction on skills and in instruction intended 
to provide information . Complex skills , such as flying 
aircraft/ are readily decomposed into a number of component 
skills each of which may perhaps be taught separately. 
Indeed/ it is usually possible for very complex skills 
to be hierarchically decomposed into sub-skills which can 
then be further subdivided into smaller cortponents. With 
this type of material the ordering principle which offers 
itself most prominently is the prerequisite-criterion 
relationship; i.e./ some skills are prerequisites to 
other skills. The crucial problem in this topic area is 
determining what skills are prerequisites of higher order 
skills. 

In the teabhing of information / interrelationships 
can be identified as existing among concepts to be 
communicated. A concept/ which is usually stated in 
the form of a rule, has associated with it a set of 
instances or examples of the concept. Both the rule and 
its examples must ordinarily be presented. This particular 
relationship is associated with tv/o possible principles 
of ordering: the inductive principle in which examples 
are presented and the rule is subsequently discovered 
by induction/ and the deductive principle in which the 
rule is presented first and is shown by deduction to 
include the examples. 

Inductive ordering is illustrated as follows s 
The smoke from a cigar rises. 

If hot air is trapped inside a balloon/ the balloon 
can be made to rise. 

When you open a refrigerator/ you can feel a cold 
draft coming out of the bottom. 

On a stilli clear night/ cold air collects dn the 
low places and sometimes shows its effect in the formation 
of fog. 

On a hot sunny day, columns of rising warm air form 
cumulus clouds. 
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The name of this principle is convective circulation. 



The rule describing the principle is that air warmer 
than the surrounding air tends to rise^ while air cooler 
than the surrounding air tends to sink. 

Deductive ordering would present the principle first, 
followed by the specific* examples. The examples might be 
presented in the form of questions, such as, "Where would 
you expect cold air to collect on. a still, clear' night?" 
Negative instances might also be presented, for example, 
"A heli\im filled balloon will rise - is this an exeimple of 
the principle?" 

Concepts themselves may be interrelated, and in 
particular they are often arranged in hierarchies such 
that concepts are grouped together to constitute a super- 
concept or superset, A very well known example of this 
type of interrelationship is biological taxonomy i For 
example, rabbits and rats are grouped together to consti- 
tute rodents ♦ Rodents, canines, and others are grouped 
together to constitute mammals, and so on. Such a 
hierarchy suggest two major ordering principles that 
might be applied; these are commonly termed depth first 
versus breadth first , and upward versus downwar d # 

These two sets of principles must be taken together 
to determine a particular ordering* For ex£unple, a down- 
ward ordering would mean that instruction on biological 
taxonomy would begin with say, the anim: 1 kingdom, €^nd 
then treat the most immediate subcategories under that: 
molluscs, protazoans, chordates, etc. If we were following 
the bi^eadth first principle, we would treat all of these 
subcategories immediately under animal kingdom and 
proceed down the hierarchy in that fashion, always 
treating all of the concepts at a given level before moving 
to the next level of subclasses. If we were following 
a depth first principle, we would move from animal king- 
dom to one of its subclasses, say chordates, and move 
then to one of its subclasses, say vertebrates, and so 
on down a single branch of the hierarchy until we had 
reached the level of desired detail, we would then 
backtrack and proceed down the next branch. 
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Upward presentation would of course reverse this 
process, starting with classes at the lowest level of 
desired detail and proceeding upward* 

Influence of Non-Content Variables Upon Sequencing ♦ 
In addition to content variables , there are clearly other 
variables which must be taken into account in assessing 
the effects of sequencing. In general, these are the 
same variables that" are commonly recognized to influence 
instructional manipulations » Major examples of these 
are prior instruction cind individual differences. 

One aspect of prior instruction is the statement of 
objectives of. the instruction, that is, what behavior he 
is expected to exhibit on a test? Will he, for exeuaple, 
have to reproduce the material with some specified level 
of precision or will he have to utilize the material in 
some new content? 

Another aspect of prior instructions is the incen- 
tive structure provided for the student; what rewards 
are available to him, and what are the effective 
criteria he must achieve to gain the rewards? Such an 
incentive structure, of course, is a major determinant 
of the student *'s motivation and might substantially 
attenuate or enhance the effects of sequence « 

Another variable which is generally important in 
instructional contexts is that of individual differences. 
Of particular importance is the strong possibility that 
individual differences interact with other^ variables to 
determine the most successful sequence. For example, a 
study by Orton, McKay, and Rainey (1969), suggested that 
the inductive order of presentation may be more effective 
>/ith students of low aptitude, while a deductive order of 
presentation might be more effective for high aptitude 
students, . ' 

Methods of Presenting Sequences . Although an initial 
instructional sequence may be fully determined, there are 
in fact a number of variationii that can bo employed. A 
single, fixed sequence may be used for all students. 
Alternatively, several fixed sequences may be used which 
are matched in some fashion to student characteristics on 
the basis of individual differences. At another level of 
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flexibility, instructional branching options may be 
incorporated within the sequence, utilizing information 
developed during the instructional process to deteirmine 
the final sequence which occurs. At a still higher level 
of flexibility, the instructor may simply provide the 
student with some general information about the material 
and allow the subject to select the instructional order 
on his own. 

Measuring Ef fectiveness : Dependent Variables , The 
determination of appropriate dependent variables is a 
crucial and sometimes neglected aspect of research in 
instructional contexts. It is clear that we must start 
with criteria determined by the purpose of the instruc- 
tion. In other words, we must initially consider what 
are the objectives to be attained and must state those 
objectives in terms of desired behaviors. In general, 
it is not practical to use the criterion behaviors them- 
selves for measuring the effectiveness of instruction, 
but rather the investigator attempts to identify some 
more easily measured indices which will predict the 
achievement of the criterion behaviors. 

For example, an introductory unit on the use of the 
oscilloscope might have an objective / in terms of criterion 
behavior / that the student can turn the device on and 
make initial adjustments preparing it for use. That 
behavior could be tested^ but at considerable cost in 
time or money. At least one oscilloscope* of appropriate 
type would be required, and several would be needed for 
speedy completion of the research. An index of the 
criterion behavior might be created in the form of 
questions: 

"How do you turn the oscilloscope on?" 
"What does the focus control do?" 

Such questions seem likely to indicate what the 
student could do with an oscilloscope, but it is impor- 
tant r especially in more complex tasks to consider the 
criterion behaviors and the potential relevance of 
particular indices which might be used as dependent 
variables. 

It is often the case that instructional materials 
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have several associated objectives in addition to mastery 
of the content. One associated objective is efficiency, 
in terms of the time required for mastery. Another is 
affective response, that is how the student feels about 
the instruction he has received as expressed in his 
subjective course evaluation or instructor evaluation. 

The content criterion may in itself be reflected in 
more than one kind of dependent variable. For example, 
mastery of the content might be assessed by some form of 
reproduction behavior such as supplying the names for 
concepts or supplying definitions. On the other hand, 
criterion content might be assessed by some sort of 
productive behavior which requires the student to make 
an inference from the material he has learned or in 
another fashion produce something new with it. For 
example, a student who has learned the principle of con- 
vective air circulation might be asked to reproduce the 
principle in his own words, an acceptable answer might 
be: 

"Warm air tends to rise, cold air tends to sink." 

On the other hand, he might be asked to apply bis 
knowledge to a new case : 

"If you had a block of ice and wanted to cool a small 
room with it, where would you put it to get the fastest 
cooling of the whole room, on the floor or near th6 
ceiling?" 

It is important to recognize that the results of ciny 
study on the effectiveness of teaching materials may be 
substantially influenced by the choice of dependent 
variables and the emphasis given to indices of the several 
criteria mentioned above - content, time, affective 
response. Such consequences must be taken into consider- 
ation in any assessment of sequence effects in instruction. 

Impact of Sequence Manipulation^ on Performance . 

It is generally assumed that sequence does have an 
effect on successful instruction, but does it? The 
evidence is not quite so clear. While some studies have 
indicated a definite effect of sequence, there are in 
fact a number of experiments which contradict this con- 
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elusion. The purpose of this section is: (1) to review 
research bearing on this question, (2) to consider the 
possible conflicting results, and (3) to provide conclu- 
sions indicated by the whole body of research. 

The typical paradigm or model in this section begins 
with an experimenter-determined set of items. The 
experimenter selects an appropriate ordering for these 
items, either on the basis of some a priori principles 
or with the assistance of evidence obtained from subjec- 
tive judgments. In either case, the favorable ordering 
is treated as one level of the ordering variable, and 
its effects are contrasted with those obtained with a 
scrambled order. The exact meaning of "scrambled" may 
vary from study to study, but the intent is to produce 
an illogical and presumably unsuitable sequence. Thus, 
the paradigm would contrast a potentially effective 
ordering with what is presumed to be the worst possible 
ordering. 

The items or units which are used vary from study 
to study. In some of the research the basic units are 
words. In others they are sentences, frames of programmed 
instruction, or whole paragraphs. 

The studies are also rather heterogenous with respect 
to their choice of dependent variables, having used 
comprehension tests, free recall, time to complete the 
program, number of errors in the program, and subjective 
judgments of affective response. Comprehension tests 
consist of questions; the student answers determine the 
imderstanding of the material. Free recall is measured 
by asking the student, after he has finished studying, 
to repeat as many of the items as he can remembe?; the 
number repeated correctly is his score. 

Studies Supporting an Effect of Sequence : Applied 
Research : By applied studies we mean studies which used 
instructional material, or material which could poten- 
tially be used in instruction. The studies collected in 
this section have found an effect of sequence on a criterion 
test of free recall or comprehension. To be more precise, 
all of these studies found that the scrambled ordering 
produced poorer performance than did a logi'oal ordering. 
We ^ will take up these studies in the order of the size of 
units used in the experiments • 
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The smallest unit which has been used In these 
studies, or for that matter could conceivably be appro- 
priate, is the single word. Epstein (1963) and Yuille 
and Paivio (1969) conducted experiments on this issue 
using meaningful prose passages. These passages, which 
were taken directly from an existing text, were presented 
in two orders; the original order as written, and a 
scrambled order in which the words were rearranged. The 
scrambling, not surprisingly^ was found to have a detri- 
mental effect on comprehension. 

The next size unit which has been treated is the 
sentence. A ntimber of studies have utilized units of 
this size. All of these studies began with sequences of 
sentences which were ordered by judgment or a prio ri 
principljliii . Each study employed a nev/ order, proclvced 
by scrambling the original order and cjmpared perfOLinance 
on sorj6 criterion test under the two conditions* The 
studies used various dependent Vari9.)le3, and in general, 
demonstrated that the sequence effejts can be found with 
a variety of different dependent Virlables, Prase (1969), 
Bruning (1970), Sasson (1971), am* Schultz and DiVesta 

(1972) all used measures of free recall as their dependent 
variable. Other studies used t^sts which were intended" 
to measure comprehension: Kosjr and Natkln (1972), 
Darnell (1963), Thompson (19^:;), and Kissler and Lloyd 

(1973) . 

The highest level of unit which has been investigated 
in these studies is H.e frame as a unit in programmed 
Instruction. Ander'>on (1966) compared a rationally 
ordered sequence -jf programmed instruction with a 
scrambled order, and found that the rational order was 
more accurat*^iy remembered. Brown (1970) used a similar 
paradigm ar.a found that the scrambled order was*. (1) 
associated with more errors on the program, (2) a longer 
time lo complete the program, and (3) a lower score' on 
criterion test. Tobias (1973) also used this para- 
digm and found that with novel material a relatively 
strong detrimental effect on achievement was produced by 
scrambling the material. 

Basic research . The principle distinction between 
studies in this unit and those preceding is that the 
following studies employed artificially constructed 
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stimuli, which would not be regarded as potential instruc- 
tional material. They do, however, represent an effort 
to model some of the critical aspects of instructional 
material. 

The first area to be taken up, conceptual clustering, 
is based on the selection of items with conceptual rela- 
tionships among them and contains studies intended to 
assess the effect of an ordering based on the principle 
that interrelated items should be placed close together. 
The second area to be discussed is concept learning; that 
is, the learning to identify members of a previously 
unfamiliar concept. The studies. of interest have explored 
the effectiveness of sequencing according to the principle 
of instance contiguity? that is, the notion that several 
independent concepts are best learned if each concept is 
taken up in order and thoroughly learned before the next 
concept is studied. 

In the conceptual clustering paradigm, a list of 
relatively familiar objects is constructed so that several 
classes of objects are present: For example, such a list 
might have a vegetable class (lettuce, turnip, and pea) 
along with an animal class (horse, cow and pig). Sequences 
are formed by placing related items together, or alterna- 
tively, a presumably less effective sequence is formed 
by scrambling this order. 

Schwartz (1973) and Puff (1966) conducted studies 
following this paradigm and found that the sequences 
produced according to the clustering principle were, 
indeed, associated with more correct responses in a free 
recall post-test. Two other investigators Newman (1967) 
and Whitman (1969) deviated somewhat from this paradigm 
in that their stimulus items were nonsense syllables " 
presumed to have a clustering relationship on the basis 
of overlapping letters. Both of these investigators also 
found a favorable effect of rational sequences upon 
performance in free recall. 

Calfee and Peterson (1968) used the paradigm as 
originally described (with words representing familiar 
concepts), but with a slightly different dependent 
variable which they designated probe recall. In probe 
recall, the subject is required to recall the word 



iimediately following a test word supplied by the experi- 
menter. Here again, favorable effects of rational 
sequencing were demonstrated. 

The same ordering principle that has been used in 
the studies above has also been studied in the context 
of paired associate learning. Gagne (1950) and Rothberg 
and Woolman (1963) both found that the rational sequencing 
had a beneficial effect on rate of learning and number 
of errors. 

In studies of concept learning, the typical para- 
digm is as follows. Several independent (unrelated) 
concepts are to be learned. Each is taught through the 
presentation of multiple instances. In teaching these 
concepts, there are essentially two ways to order the 
sequence of items presented to the subject. The student 
may receive examples of one concept until he has mastered 
that concept and- moved on in succession through each 
of the concepts one at a time. Alternatively, this order 
of presentation may be scrambled so that the student is 
working on several concepts at the same time. 

This multi-concept versus single concept paradigm 
has been used by Kurt?: and Hovland (1956), Newman (1956), 
Peterson (1962), and Blaine and Dunham (1971) with essen- 
tially the same findings: presenting instances of one 
concept at a time until the sxibject has mastered that 
concept leads to more rapid learning than does its multi- ^ 
concept presentation. 

studies Not Clearly Supporting an Effect of Sequence . 
All studies falling in this category are appliecT in the 
sense defined previously in the Applied Research Section. 
Moreover/ most of these studies have dealt with freime 
sequences in programmed instruction. Roe, Case, and Roe 
(1962) and Levin and Baker (1963) compared a rationally 
ordered program - an order judged by them to be instruc- 
tionally appropriate - with the same items in scrambled 
order. The dependent variables were time to complete the 
program, number of errors or performance on a criterion 
test. Of the studies using frame sequences from programmed 
material, these studies are the only ones which found no 
facilitating effect with the rational sequence. 
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The remaining studies with programmed materials 
failed to find an effect on selected criterion tests, 
but did find an effect upon other performance indices. 

Niedermeyer, Brown, and Sulzen (1969) and Payne, 
Krathwohl, and Gordon (1967) found that the rational 
ordering was associated with fewer errors in completing 
the program. Gavurin and Donahue (1961) found that the 
rational order was associaj^ed with fewer trials to cri- 
terion. 

Two investigators studied the effect of sequencing 
paragraphs. Beighley (1954) and Lee (1965) compared 
rational ordering of paragraphs with a scrambled ordering 
and found no effect on measures which they deemed to be 
measures of comprehension. Lee also obtained judgmental 
ratings of organization for his two sequences and found 
no differences in the ratings. 

Conclusions : Effects of Stimulus Sequences . In 
drawing conclusions it is worth noting that a number of 
factors have been identified which might produce an 
attenuation of sequence effects. Familiar material is 
evidently less likely to produce an effect of Sequence 
(Tobias 1973) , presumably bece^use familiarity insures that 
the subject already has a conceptual framework and so is 
not substantially handicapped by a lack of order in the 
material. Tobias, in fact, showed that a sequence effect 
would be demonstrated with novel material but not with 
familiar material. 

Criterion measures also appeared to influence the 
extent to which sequence effects will be observed- 
Kissler and Lloyd (1973) used two different criterion 
measures and found a strong effect with short answer 
items, while they found negligible effects with sentence 
completion items. Presumably, the short answer items 
were more demanding and more sensitive to the experiments' 
manipulations. 

As might be expected from the rationale for choosing 
sequences, the interrelatedness of items apparently has a 
substantial effect on whether a sequence effect will be 
found. Kissler and Lloyd (1973) used two levels of the 
interrelatedness variable and found that the effects of 



ERIC 



18 



sequence was much attenuated when the Items were low in 
interrelatedness* The possible attenuating effects of 
a lack of Interrelationship among items has also been 
suggested by Brown (1970) and by Niedermeyer, Brown and 
Sulzen (1969). 

In addition to the factors which have been identi- 
fied experimentally, other factors have been suggested as 
contributing to difficulties in finding sequence effects. 
It may be noted that most of the studies which produced 
ambiguous or negative i;esults dealt with programmed 
instruction. One possibly important characteristic of 
programmed instruction is a high level of repetition or 
near repetition of items. The redundancy in program 
instruction might result in two effects* First, as 
suggested by Natkin and Moore (1972) and by Anderson 
(1967), the scrambled sequence would result in a distri- 
bution of repetitious iterrts throughout the sequence. This 
could lead to a consequence similar to that of distributed 
practice, which has been shown in other studies to 
favor retention (Greeno, 1964j Melton, 1970; Underwood, 
1969; Shaughnessy, Zimmerman, and Underwood, 1972), Ah 
alternative possible consequence of the redundancy in 
programmed ins.truction might be that the use of redundant 
items in close association may diminish the attention 
given to them, while distributing the items throughout 
the sequence might favor greater attention. This 
possibility was suggested by Roe, Case, and Roe (1962) 
and by Anderson (1970). It is noted that these two 
explanations are not necessarily logically independent. 

A more general reason for difficulty in finding 
sequence effect^s is that there may be no adequate basis 
for producing good sequences (Natkin and Moore, 1972), 
It may be that the sequences used were not by any means 
optimal and so did not give sequencing an adequate oppor- 
tunity to have an effect. 

In conclusion, we observe that negative results are 
relatively rare in the set of studies we have reviewed. ' 
In most cases, e\ten those which failed to find an effect 
on the criterion test found some favorable effects of 
sequence on other dependent variables. Thus, we can 
conclude that the overall weight of the evidence favors 
the conclusion that sequencing does have em effect on 
learning. One important caution should be noted. The 
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comparison in each case constituting the unfavorable 
Sequence was a scrambled order and not soine alternative 
rational order. Clearly the scrambled order is not one 
which would normally be used in presenting material so 
that, while scrambled orders are most likely deleterious, 
it remains to be demonstrated that some rationally 
chosen orders are more effective than others # Until 
this question is answered it will not be known whether 
sequence effects are of any practipal importance. 

Subject Versus Experimehter-Determined Sequenced . 

As noted earlier, it is quite possible for a subject 
to determine his own sequence in using instructional 
material. Is it possible that the entire problem of 
sequence determination can be loft to the subject? If 
so, it is not necessary for the person preparing the 
instructional materials to give substantial consideration 
to the sequencing problem. A number of studies have 
investigated this question, and the results will be 
reviewed in this section. 

Applied Studies . 'JJhe general jparadigm for studies 
of this sort is as follows. A more or Tesa st£mdar9 
instructional sequence is imposed upon one group of 
subjects, while another group is given substantial 
freedom in choosing the sequence of materials. The 
particular procedures for choosing ihe sequence in the 
subject-determined condition varies substantially . from 
study to study and cannot be given a general character- 
ization. 

Three studies used progreunmed instructional materials 
in this paradigm and all found effects favoring the 
subject-determined sequence. Kapel (19(55) used linear 
programs in history with ninth grade students. One group 
studied the programmed materials in their prescribed 
order. The other group was encouraged to search ahead 
whenever they felt it would be useful to them. The 
experimenter-determined sequence was associated with 
better performance on a test given immediately after 
the students completed the material, but a similar 
criterion test administered one month later showed 
better retention on the part of the subject-determined 
sequence group. 



Silberman, Melaragno, Coulsoii/ and Estavan (1961) 
used programmed instructional materials with an automated 
presentation system which allowed students to see only 
one freoue at a time. In this study they employed three 
groups. One group, the stcoidard experimenter-determined 
group proceeded through the material frame by frame 
without an opportunity .for review. The second group, 
termed a back-branching group, was permitted to go back 
one frcune. at a time for review. A third group was 
presented the same material in paragraph form in a way 
that permitted the subjects to see all the material at 
one time. The presumption was that members of the third 
group had the opportunity to determine their own sequences 
since all of the material was simultaneously available to 
them. Performance on a criterion test indicated that the 
third group performed better than the first, but not 
significantly better than the s.cond group, \fliile these 
results might be interpreted as indicating that the 
student determination of sequence facilitated learning, 
the results are somewhat confounded by the fact that 
the second group, which did not have an opportunity for 
subject detenninatiijn, did ^bout as v;ell as the third 
group. It should be noted that the manipulations used 
in this study confounded an opportunity for review with 
an opportunity for selection of sequence, and on the 
basis of the comparison between the second and third 
groups, it may be more reasonable to conclude that, the 
opportunity for review was the major contributor to the 
superior performance shown by the third group. 

Grubb (1969) used programmed instructional materials 
covering elementary statistics. The study employed five 
conditions ranging from complete experimenter control to 
complete learner control. Results on a criterion test 
indicated that complete learner control produced the best 
performance and, in general, performance decreased as 
learner control decreased. 

Dean (1969) used instruction on an elementary arith-- 
metic task. One group was given a fixed linear task 
while the other was given complete freedom to choose 
the order in which they studied the materials. He con- 
cluded that there was a gain in performance associated 
with the learner control condition. 
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Mager and Clark (1963) used students in an industrial 
training program • One group proceeded through the regular 
curriculxm in the usual fashion. The other group was given 
an explicit statement of training objectives , and students 
were encouraged to confer with the various faculty members 
and so arrange their program of study to suit their needs. 
The sfiudents in the latter group were found to require 
less training time, and the author concluded that they 
were better prepared. Unfortunately this study confounded 
the learner control variable vith administration of 
explicit instructional objectives. Thus, it is impossible 
to assess the independent contributions of these two 
variables. 

An earlier study by Mager (1961) was conducted 
primarily to determine whether subjects would in fact 
choose the same sequences that are chosen by persons who 
prepare instructional materials. Mager allowed six 
subjects to generate their own sequences in studying 
elementary electronics by asking the instructor questions. 
He concluded that the learner-generated sequences bore 
little resemblance to those used in teaching introductory 
electronics. There was considerable commonality among the 
sequences* generated by the subjects, in that the subjects 
preferred to begin with a simple, concrete unit such as 
a vacuum tube and proceed upward to more complex units 
such as complete radio circuits. Traditional sequences, 
however, start with basic theory (such as basic electri- 
cal theory-electrons / current flow, static charge, etc.) 
before proceeding to concrete units of increasing complexity. 

A series of studies by Campbell (1964) compared 
groups which used programmed instruction material with 
groups which were allowed self-directed study. The self- 
directed set of groups were provided with a short basic 
text, supplementary examples and explanations, self-testing 
questions, and an outline of the lesson. Performance on 
a criterion test was not found to be affected by these 
alternative learning conditions. 

Atkinson (1972), using computer assisted instruction, 
compared subject-determined sequences with experimenter- 
determined sequences which included branching on the basis 
of the student *s performance. The results indicated that 
the experimenter-determined sequences were more effective 
for learning. 
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Basic research * All of the studies in this section 
can be charaoterTzed as representing the reception versus 
the selection paradigm in concept learning* In the selec** 
tion paradigm subjects are presented with an instance 
array containing all examples of the concept they are to 
learn. The subject is permitted to choose the instance 
to which he wants to respond. He then guesses whether it 
is an ex€unple of the concept or not and is given the 
correct feedback. In the reception paradigm^ the experi- 
menter presents one instance at a time and requires the 
subject to respond to that instance before giving him the 
correct classification information. 

The studies in this section have also characteristi- 
cally used a "yoking" procedure to determine the sequence 
to be used in the reception paradigm. A sub ject in the 
selection group is permitted to determine his own order , 
and then the same order lis imposed upon a corresponding 
subject in the teceptibn group. This "yoked control 
design" has been severely criticized by Church (1964)* 
There are logical and statistical reasons to expect that 
the design would produce an artifactual difference in 
favor of the student who determines the sequence; these 
reasons are fairly complex ^ but rest upon the fact that 
a sequence produced by a student to^fit his own momentary 
needs for information may not be well suited for anyone 
else. Thusi the sequences used for students in the 
reception condition might not be as good as could have 
been produced by some other method; by studying the general 
pattern of choices in the selection paradigm and devising 
a single soquence embodying the common characteristics 
of these choices while avoiding idiosyncrasies. 

One of these studies^ Hunt (1965) i found that the 
feelection group made fewer errors than did the reception 
group. Two other studies ^ Huttenlocker (1962) and ' 
Murray and Gregg (1969) found that the reception paradigm 
was associated with fewer errors. ThuSi the results in 
this set of studies are guite inconclusive. Given the 
biases which might be expected as a result of the yoked 
control procedure I the Hunt study might be regarded as 
relatively weak evidence in favor of the selection paradigm 
and probably the overall conclusion with respect to 
these studies tends to favor the reception paradigm. 
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Conoluslbn8 < Learner Verexia Experltttehter Control s 
This preceding review indicates that several applied 
studied found a favorable effect of learner-selected 
sequences. Unfortunately/ these studies generally 
suffer from methodological defects which confound other 
variables with the learner versus experimenter variable. 
In partitsular, several of the studies provided an over- 
view to t;he learner in conjunction with the learner 
selection condition. It Lr quite possible, and indeed 
plausible, that an overview constitutes additional 
instruction which would in itself facilitate learning 
regardless of whether the subject is permitted to select 
his own sequence or not. Indeed, there is evidence that- 
advanced organizers such as overviews lead to enhanced 
retention of instructional material {Ausubel, 1960? Ausubel 
and^ Fitzgerald/ 1962; Scandura and Wells , 1967). Purther- 
mordr^some of the learner selection conditions offered 
greater opportunities for review and for skipping of 
items; both of these factors might reasoneibly be expected 
to enhance certain performance criteria. 

There are also problems in interpreting the possible 
motivational effects which might have, been produced by 
the learner-selected sequence. Such a condition is 
relatively novel to most students and might have been 
associated with greater attention from th^ instructor. 
It is not uncommon for subjects to respond to what they 
perceive as special treatment with higher levels of 
motivajbion. Beyond that, the mere opportunity to select 
one's own training sequence may in itself be motivating. 
Thus, learner-determined sequences might in fact improve 
performance, but in a way that could be duplicated with 
experimenter-determined sequences if appropriate motivat- 
ing conditions were added. 

Still another problem with these studies is that the 
experimenter-determined sequences may not have been 
optimal. Indeed if we suppose, as seems quite possible, 
that there are individual differences with respect to 
the most favorable sequence, then it is highly unlikely 
for a single , sequence to be optimal for all subjiects. 
It may be noted that the study by Atkinson (1972), which 
used branching based on the subject's errors, led to 
results favoring experimenter-determined sequences. The 
procedure used by Atkinson would have partially matched 
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the Instructional sequenco to the needs of the subject 
andi thus, might be expected to have produced a better 
sequence for that subject than a fixed experimenter- 
determined sequence. Since the subject in the learner- 
selection paradigm has an opportunity to fit the sequence 
• to his own needs, it will probably be important to 
cbmpare that condition; not with a single experimenter- 
:<Jetermined sequence, but with experimenter-determined 
sequences that have been matched carefully to the particular 
characterisiics of the subject'. 

On the other hand, studies which have shown a 
favorable effect of experlmer/ter-determined sequences 
provide relatively weak evidence with respect to practical 
application. There is some indication from the studies in 
concept learning that the reception paradigm . is more 
effective, but the applicability of the conclusions to 
real learning situations is subject to challenge since the 
material in concept learning studies is quite artificial. 

In summary, we are obliged to conclude that relatively 
little is known about the effects of learner-determined 
se quen ces on learning in pra ctical ^sit\ifitiiaifiLu ^ * ♦ ^ ^ 

Recommended Research . Where do Me go from here?^ 
The first question, of course, is what kind of research 
needs to be conducted to provide clearer evidence on the 
effects of the discussed factors than that described 
previously. Clearly, research in this area must take 
into account the following problems identified in the 
previous section: 

• Care must be taken in designing experiments to avoid 
confounding other variables with the selection variable. 

• Appropriate procedures must be utilized to control 
motivation. 

• If there are individual differences in the optimal 
sequence for learning, then certainly sequences will have 
to be matched to the individual subjects. 

• More generally, of course, the fitting of optimal 
sequences to individual subjects will require that we 
have procedures for determining optimal sequences. 



ERIC 



There are a nuirtber of potential Interactions with 
other variables which also must be taken into account in 
Studies in this area* For example, one might reasonably 
expect that familiarity with the mateifial would ''interact 
with the effectiveness of subject-selected sequences. 
With moderately familiar material ^ the subject might be 
substantially more effective in selecting his sequence 
than with totally unfamiliar material. Furthermore, there 
may well be individual differences in sequencing skills. 
Thus, some subjects, perhaps those who are generally the 
most successful learners, may be quite able to sequence 
material for themselves, while those with less satisfac- 
tory scholastic backgrounds and less favorable learning 
experiences may require more guidance in sequencing their 
instructional materials. 

In any case, it is unlikely that practical applica- ' 
tions will see pure cases of either learner-determined 
sequences or instriir-hor-determined sequences. Except with 
computer-assisted instruction and with lectures, the 
student normally has substantial opportunity to determine 
his own sequence regardless of the ordering of the text 
material. Given a book, manual/ or programmed instruction 
unit he is usually at liberty to skipi around as. he pleases. 
Thus, the learner-determined sequencing is perhaps only d 
matter of degree. Given more encouragement and the 
assistance of an overview, the subject may do more sequenc- 
ing on his own. But most learning circumstances allow him 
to do as much as he pleases anyway. 

Conversely, there is no way to present instructional 
material except in some sequence. The in.^tructor must 
determine the sequence in which the items appear in his 
text, even if he does not expect the subject to make full 
use of that sequence. It is most unlikely that instrtlctors 
would take the view that any sequence of items is as good 
as any other, since the sequences provided by the instruc- 
tor are likely to act as guidelines even when substantial 
learner selection is taking place. 

" Principles of Stimulus Sequencing . 

The research reviewed to this point that there is 
good reason to expect stimulus sequencing to play an 
, important role in the preparation of instructional 
materials. It is now time to review in an organized 
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fashion the several principles of stimulus sequencing 
which have thus far been proposed and subjected to signi- 
ficant amounts of research* It is possible to organize 
these principles under five major headings: 

Inductive Versus Deductive Sequencing 

Sequencing of Hierarchical Material 

Conceptual Clustering 

Sequence Organization Based on Concept Name Versus 
Attribute 

Content Independent Sequencing Principles 

Under each of these heading^ we will discuss the 
empirical findings and then present our evaluations and 
conclusions. 

Inductive Versus Deductive Sequencing ^ The two 
principles to be treated in this section apply to material 
in which a general rule is to be learned^ presumably along 
with its applications to specif ic^instanc^B, The presence 
of a rule and specific instances readily suggests two 
possible sequencing principles. One, inductive / calls for 
presentation of specific exeunples of the rule, offering 
em opportunity for the student to formulate or induce 
the general rule on the basis of his experience with the 
examples* The alternative principle, deductive , is 
exactly the reverse, calling for the presentation of the 
general rule first, followed by occasions which require 
the student to apply the rule* These principles have 
been studied not only under the names given above, but 
also under the names - discovery learning for inductive 
sequencing and guided learning for deductive sequencing. 

Empirical findings . The results of empiric$il research 
in this area are mixed and appear to be somewhat dependent 
upon the paradigm and upon the dependent variable and the 
time of its administration. Several studies have reported 
that inducfcive is better than deductive sequencing. Kersh 
(1958) used mathematical problems. These were presented 
to two groups of subjects. One group was given the prob- 
lems without assistance and asked to solve them. The 
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other grovp was given a general rule which would aid in 
the solution of the problems and then given the same 
problemr/ to solve* The students were tested on a twenty 
item achievement test immediat<6ly after the training 
session and on a similar test four weeks latere The 
results indicated that higher^^performemce on the achieve- 
ment test given immediately after the training was 
associated with the deductive (rule given) procedure. 
But on a similar achievement test given four weeks later, 
higher performance was associated with the inductive 
procedure* 

Ray (1961) undertook to teach the use of micrometer 
calipers, A deductive group listened to a lecture in 
which the rules for a caliper use were given emd applica- 
tions were then illustrated. An inductive group was 
principally instructed by the use of leading questions 
to the group by the instructor. On the basis of perfor-* 
meince on a test given one hundred minutes after completion 
of the instruction, the author concluded that learning 
was more effective in the inductive group, 

Tallmadge and Shearer (1969) gave instruction on 
operations research procedures for finding the minimum 
cost solution for transportation problems. Ah inductive 
group was instructed by a presentation which was "designed 
t6^- produce an understanding of the concepts and principles 
as well as the problem solving procedures.^ A second 
group received instruction which was "deductive, didactic/ 
and rote." A test immediately followed the training 
session showed superior performance associated with the 
inductive sequencing. It may be noted that these proce- 
dures appear to have confounded another instructional 
variable/ meaningful versus rote learning^ with the 
variable principally under study. It is generally recog- 
nized that meaningful learning is more effective, and the 
results must be interpreted in this light. 

■ ^ ■ - ■ 

Haslerud and Meyers (1958) used a within subjects 
design/ presenting both types of training to the same 
subjects, so as better to control for individual differ- 
ences. The required subjects to learn an artificial 
task, the tremslation of sentences into codes. • For half 
of the problems, the coding principle was given, and the 
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subject was required to apply it. These problems 
constituted the deductive condition. For the other half 
of the problems / a set of examples was given for each 
problem. The subject was required to stvidy the examples 
and then to translate a new sentence according to the 
rule illustrated by the examples. A test of ability to 
apply the rules was given immediately after training; 
the deductive sequencing was found to produce better , 
performance. But on a similar test given one week 
later/ superior performance was associated with the 
inductive sequencing. 

Three studies have produced results interpreted as 
indicating that deductive sequencing is better than 
inductive sequencing. Craig (1953) and Craig (1956) 
required Air Force personnel/ in the first case, and 
college students in the second case, to utilize sehiantic 
concepts. The basic task required the subject to solve 
a problem by identifying one word in a set of five 
which did not conform to the concept rule. The deductive 
group was given the concept rule applying to each set of 
words before he was required to solve that problem. The^ 
members of the" induc€ive group were sitt^>ly required to - 
solve the problem without guidance. Tho author concluded 
that the deductive group obtained accurate solutions to 
more of the problems and were better able to verbalize 
the rules. These results are scarcely remarkable. The 
rules were given to the deductive group but not the 
inductive group? therefore, it is only to be expected 
that the deductive group be better able to verbaliize 
the rules. Moreover, the deductive group was clearly 
given more instruction than the inductive group, so that 
they differed not merely in sequence, but in amount of 
instruction. 

Belcastro (1966) used programmed instruction covering 
elementary algebra* The programmed material Included 
frames presenting the rule and frames constituting examples 
of the rules. In the deductive condition, the r.ule was 
given first followed by the examples, and in the' inductive 
condition, this sequence was reversed. He used a criter- 
ion test subdivided into three components: a verbal test, 
a non-verbal test, and an applications test requiring the 
student to use the training to solve problems* On the 
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overall score/ tho sum of all three tests / superior 
performance was associated with the deductive training 
method. On the applications tes^^, however / the two 
training methods were associated with equal levels of 
performance. ' 

Three other studies used programmed Instruction 
materials and produced inductive and deductive conditions 
in a manner similar to Belcastro • (196^) . > Krumboltz and 
Yarboff (1965) used materials on elementary statistics 
and found no difference between the two groups on a 
criterion test administered two weeks later. The deductive 
group /however/ reported that they were more satisfied 
with the text. Koran (1971) replicated the Krxunboltz * 
and Yarboff study and also found no differences between 
the two instructional methods on the criterion test. 
Wolf (1963) used mathematical programmed instructional 
materials and also found no effects associated with the 
sequencing variable. / 

Two other studies/ not using programmed material, 
indicated no differential effects of sequencing. Fergus 
and Schwactz (195Z) required college students tq^ learn 
an artificial alphabet. In the deductive" group l;he ^ 
students were given the principle for generating thft 
alphabet/ and in the inductive group they wer^ given 
examples and required to discover the relevant principle. 
In a recall and transfer test giveA one week later, no 
differences were found between the two groups. Sobidl 
f (1956) studied the effects of training in a four week 
unit of algebra. Ordinary classroom instruction was used 
except that for the deductive group the teachers were 
instructed to teach in a fashion consistent with deduc- 
tive principles, and for the inductive , group the teachers 
were asked to teach .in a fashion consistent with inductive 
principles. The two training methods were found to be 
equally effective on a multiple choice achievement test* 

Conclusions : Inductive Versus deductive sequencing . 
Vpon initial consideration, tiie results seem to weigh 
slightly in favor of inductive sequencing. ^There are, 
however, several qualifications which should be appended. 
The major qualification Is that inductive sequencing, 
as used in several of the above studies, may have resulted 
in higher levels of motivation. The inductive task was 
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sometimes presented as a puzzle which may have been rather 
intriguing jyin nature^ with the result that it roight have 
illioi ted great attention (Koran ^ 1971)^ Krumboltz and 
Yarboff/ i965}. Some of the studies may also have con- 
founded the amount of activity required of the subjects 
with the inductive sequencing condition. For instance 
the inductive sequencing condition may hav& also be^n 
associated with longer study time. Both of these problems 
and possibly the motivation problem^ would be substantially 
diminished in the context of programmed instruction. 
It may be noted that those studies which utilize programmed 
instruction did not find any differential effect associated 
with the alternative types of sequ<§ncing* 

Another qualification which must J^e applied in evaluat 
ing these studies is the issue of individual differences. 
There is reason to expect that there may be in5)ortant 
individual differences in responsiveness to inductive or 
to deductive sequencing such that neither may ck clearly 
more effective across a population, but one or the other v 
V may be more effective for a given student. This Issue 
yill be treated jnnore extensively in a later sectien on 
individual difference vari^lbles. 

Finally, there remains the question of whether current 
studies have an adequate method available for finding 
optimal sequencesji It is by no means clear that the two ' 
extremes, which have been used in the above studies, 
constitute the entire set of reasonable alternatives. 
The general principle being investigated by the studies 
in this section may be viewed as one specifying the point 
in ah Instructional sequence at which the rule is given. 
Obviously, the rule may be given not only at the start or 
at the end, but also at some point in the middle. It is 
quite possible that there is an appropriate point in the 
instructional sequence for providing the rule, and this 
point may be associated with the individual learner and 
his readiness to utilize the rule*. 

Sequencing of Hierarchical Material . There are at 
least two ways in which material may come to be regarded 
as hierarchical. As noted previously, there are certain 
kinds of material which are in themselves conceptual 
hierarchies. An excellent example is the biological 
< taxonomy, remging downward from the euiimal kingdom through 



ERIC 31 



\ 



chordates and molluscs to increasing specific levels of 
classification • This strudture may be regarded as a* set 
of concepts orgeuiized in terms of subsets and supersets. 

A second way in which material may be regarded as 
hierarchically organized results from an analysis of a 
criterion -skill into component subskills which are them- 
selves decomposed into still finer . components . The lower 
levels of the hierarchy are prerequisites to mastery of 
the criterion, and this kind of relationship is typically 
called the prerequisite-criterion relationship. While 
there is no strong reason to expect that the same psycho- 
logical conclusions will apply to both of these hierarchical 
organizations/ they are susceptible to some of the same 
sequencing principles/ and for that reason they are included 
together in this section. 

The major ordering principles which apply to hier- 
archical structures are: breadth versus depth and downward 
versua upward . In a breadth first presentation/ all 
material^ at a given level of the hierarchy is presented 
at one time before proceeding to the next level* This 
sequencing may be likened to the presentation of a map 
representing a whole country and describing each of , its 
provinces before describing any of its cities and t^owns. 
In a depth first presentation/ all material on a^^— 
particular branch of the hierarchy is presented at one 
time before turning to another branch. This approach 
is comparable to a presentation which stai^ts with , a ' 
whole country/ proceeds immediately to a single province/ 
and from there to a single city, and from there to 
neighborhoods* In the downward sequencing/ the highest 
level of the hierarchy is presented first and in uplward 
sequencing the converse is true. The illustrations 
just given were sequenced downwards. Upward sequencing - 
would start with neighborhoods* 

Empirical findings : Hierarchical sequencing * We 
will first take up findings which bear upon sequencing in 
the context of superset-subset conceptual structures. 
Lee (1965) contrasted the effects of two lectures/ one 
designed to emphasize the hierarchical structure ef the 
material/ the other designed to avoid that emphasis* 
The results demonstrated that the hierarchical emphasis 



led to better performance* on tests of utilization and 
retention. 

Focusing on the specific question of breadth-first 
versus depth-first presentation, Crothers (1969) used an 
artificial hierarchical structure and found that recogni- , 
tion learning was faister when the presentatioft order 
confonned to breadth-first presentation as contrasted 
with depth-first. Short and Haughey (1967) used a 
language arts program and lessons on science. They 
contrasted methods of presentation designed to emphasize 
breadth-first or depth-first presentation and found on 
a retention test given one week later that superior 
performahce was associated with breadth-first presentation. 

On the question of upward sequencing versus downward 
sequencing, Newton and Hickey (1965) used two methods of 
teaching about the concept of gross national product. 
One sequence started with that concept and worked downward 
through concepts , such as investment , consumption i govern^ 
ment spending, and so forti). The other sequence started 
with these lower level cohcopts and worked upward. The 
downward sequencing method produced more rapid learning. 

With regard to prerequisite-criterion hierarchies, . 
three studies (Scandura, 1966^; Scandurk, 1969; and Lee, 
1967) have shown that in concept learning or problem^ 
solving tasks, training on the prerequisites was 
associated with superior criterion performance. 

* Gagne has proposed that learning intellectual skills 

is dependent upon prior learning of prerequisite tasks 
and that training in prerequisites should be more effective 
than repeated practice of the criterion skills. Piel 
(1972) investigated the second part of this proposition 
in a study using materials dealing with the construction and 
interpretation of graphs. There were three instruction 
units and after each unit each subject took a diagnostic 
test followed by remediation instruction if indicated. 
Two groups were treated differently with regard to the 
remediation method. Subjects in one group received 
additional instruction on the unit just completed; those 
in the other group received remedial training on the 
earlier units. A criterion test at the completion of 
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the three units indicated that superior performance was 
associated with remedial instruction on prerequisite 
tasks* Thus the results supported Gagne's proposal. 

A study by Merrill (1964) used artificial instructional 
material on an imaginary science presented in a coit?>uter- 
assisted instruction format* He used procedures which 
resulted in different amounts of prerequisite remediation 
as the result of errors made by the subjects • His findings 
were that first, and inevitably, those subjects who 
received more remediation training took more time on the 
unit.* Second/ and more importantly, he found that their 
performance on a criterion test was no better than other 
groups which received substantially less or no remediation 
training. 

Conclusions ; Hierarchical sequencinci principles . 
The * evidence in this topic area is quite skimpy . With 
regard to conceptual hierarchies, the little evidence 
available tends to favor breadth-first presentation 
and downward sequencing. This evidence is essentially 
unequivocal, but it is difficult to determine whether the 
lack of conflicting evidence results from the strength 
and simplicity of the effects of the variables or from 
the paucity of studies on the topic. 

With regard to the question of training on prerequi- 
sites a comment is first in order. A prerequisite is by 
definition something which must be learned first. Thus, 
to some extent studies supporting the effectiveness of 
this variable really tend merely to the conclusion that 
skills constituting prerequisites can be identified and 
shown to be effective. As to whether it is inost useful 
in remediation to give additional training on prerequisites 
or not, the issue is completely in doubt since the two 
studies bearing on this topic give conflicting results. 
Additional studies with conceptual hierarchies are needed 
to test the generality of evidence favoring breadth-first 
presentation and downward sequencing; if this sequencing 
principle is effective, it could be applied to adv£mtages 
in many instructional contexts. Further resfearch on the 
effectiveness of training on prerequisites may not be 
needed; more Important is research on methods for identi- 
fying prerequisites in some systematic and efficient way. 



Conceptual Clustering and Related Effects . The 
studies in this area are primarily bMio research* Three 
topics will be taken up under this heading: (1) conceptual 
clustering^ (2) concept learning, (3) massed versus dis- 
tributed practice. 

The major topic of conceptual clustering is associated 
with the following paradigm: A list of words representing 
several familiar classes is presented to the sijd^ject, and 
he is subsequently required to recall them in any order he 
pleases. The order in which the words are presented may 
be such that members of the same class arc located conti- 
guously in the sequence (clustered) or such that all the 
classes are intermixed. The other two paradigms are 
closely related and will be described as they are taken 
up in the discussion of empirical findings. 

Empirical findings : Conceptual clustering . The 
results of research on conceptual clustering have generally 
shown that more items are recalled when items, representing 
each separate concept, are clustered together in the pre- 
sentation list. In a free recall task, this clustering 
effect has been demonstrated by Schwartz (1973) , Puff 
(1966), Newman (1967), and Whitman (1969). Using a 
slightly different task, probe recall, Calfee and Peterson 
(1968) demonstrated the clustering effect. Applying the 
same principles to paired associate learning,) Gagne 
(1950) and Rotberg and Woolman (1963) also demonstrated 
the clustering effect. 

Effects somewhat similar to the above have been 
shown in basic research on concept learning. In the 
traditional concept learning paradigm a subject is 
presented with stimuli which could be instances of the 
concept. In fact, some are concept instances and some 
are not. The subject*^ task is to classify each stimulus. 
Following his response, the subject is given information 
as to their correct classification, if more than one 
concept is to be learned, a sequence of instances can 
be arranged to cluster all of the items constituting 
practice on one concept together or to intermix the items 
such that several concepts are being learned at the same 
time. It should be noted in this context, that the 
concepts to be learned are typically constructed so as 
to be entirely unrelated to each other, in contrast to 
some of the research cited earlier in which hierarchical 
structures interrelated the concepts. 

ejIc 



The general finding area with studies contparincf the 
eff^pt of dlustdred versus intermixed concept items is 
that clustering of items on each "concept leads to more 
r«ipid learning - that Is, to fewer trials to a criterion v 
of mastery. Studies supporting this conclusion are: 
Kurtz and Hovland (1956), Newman (1956) , Peterson (1962), 
and Blaine aind Dunham (197i) . 

The third area of research is included here because 
4.t may set limits on the findings noted abovpf One 'might 
reason that since it is apparently useful to put several 
items bearing on the same concept close togeither in the , 
training sequence, it might also be useful to put repeated 
items close together, indeed, that reasoning would seem 
to be the logical- extension of the abpv^ f indingsi 
Apparently , that Would be an incorrect epnolU8ic>n . 
Pepeated items are found to be more effective in proigpting 
learning if they are disti^ibuted through the sequence . 
rather than grouped together. The following studies have 
supported this conclusion using a free recall tasks 
Shaughnassy, Zimmerman, and. Underwood (1972) , Melton 
(1970) , and Underwood (1969). Greeno (1964) has . , 
demonstrated the superiority of the distributing repeated 
item in a paired associate learning task, and Rothkppf 
and Coke (1963) have shown th^it the effect is also 
found with the recall of sentences. 

Conclusions ; Clustering and related effects . The 
results under this topic are relative ly unambiguous and - 
tend to indicate that instructional material beating on 
the same concept should be grouped tpgether. If, hqii|iver 
items are explicitly repeated* Such items should n6t we 
grouped together but distributed thrbugliOut the sequence. 
Thete remains two presently identifiable issues that need 
to be resolved. Firsti are the&e effects, which are 
fairly well ddmorts trated in basic iresearch , also to bp 
found in applied research Using actual instructional 
materials? Second, at what point does th6 principle , 
Wit xspncepts together, yield to the prihcjiple, distribute 
fgghti'cal items . The question i^ r what constitutes an 
identical Item? le the effeot found only when items are 
phraeed identicaliyV or is it i>pseible that differetitly. 
phrased it^ms intended tp teach the san^ concept also be 
separateii in the £iequen6e? 




lii ttvwiy praotical ittstiructional conte}?£i^lFTi7p<>$slbXe. to 
Identify ^ajjtioular irif ormatlonal structured which relate 
cohcepts to their assbctatecl attributes . To 'ctascripe . 
these structures, it will be convenient to start vith an 
exaJnpiei consider; for" example, military vehicles. Each 
vehicle type constitutes a cohcept. and associated with 
each vehicle type 10 ^ set of oharaote^isHos br attifir 
butes (bo lor r shape r * pre^,^nce of weispons c' etc. ) 
If . soinsone is feqUiired to become familiar, with militaty 
vehicie8 ^ he is 'likely to have to know bijjidi the naitjes. of ^ 
the veHicte cidsses , - 1^ conceptsV and their as;spolate 
attributes^ There are two idehti f laJ?le s tifuctures f o* 
this kih«i of lhf6rmaU6h| «u^4 eftcH Struptute mi^t 
suitable for a dt^fereht purpose. A ph6toitite?bi*€^tej? >fl 
is required to identify typeg: of military wehtOli^s frpB! . 
the attributes available i a a photbgrapj) Mght-Jje p^^^ 
with an identificatioh key <a list .of attributes ,jM><31:: their \.^|| 
values for various vehicle* types) which, allows h^.m to, -fyMi 
start with the attributes and use the combination of 
attributes he has found to select a particular vehicle. 
Thus, his information is best organized by focUsing.vUi>on 
the attributes.* 

On the Other hand, a person who must make higher 
level US6 of photoihterpretation receives, the Infprmatipn 
that a particular vehicle has been identified an4 nee^S " 
to know the particular characteristics of that veht^ls. 
Thus, his information would be best struotured by listing 
each vehicle separately with its associated charaOteristics 
or attributes. This second structure places priinary . 
emphasis oh the concepts. In this particular . context 
both sources Of information might actually be manuals < 
available for reference, but in many othfer cases the . ^ 
information has to be learned* We may reasonably ask 
how this material should be ordered in presentation. 
It could be ordered by presenting each concept and its 
associated attributes, or it could be ordered by taking 
one attribute at a time and describing all of the concepts . 
. in terms of that attribute. 

Erripirical findings » ' Concept name' ve rsus attyibute . 
The relatively few studies on this topic havfe used . 
meaningful verbal material. Prase (1969a) and. Sohult^ 
and DiVesta (1972) presented passages in which statements 
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were organized by concept name or by attribute . The 
following example Is taken from Frase t 

The pawn is worth one point*. 

The bishop is worth three points. 

The pawn moves in a forward direction. 

The bishop moves in a diagonal direction. 

The above sentences are organized by attribute; ^iiat 
is, the first two sentences give information about the^ 
value/ and the last two give information about allowable 
moves. In order to organize the sequence accordihg to 
concepts, the two statements about the pawn would h^ve^ 
been placed together, as would the two statements about 
the bishop. 

It may be noted that the Frase study used eight 
attributes and six names. The Schultz and DiVesta 
study used six attributes and six names. Thus iri both 
of these studies , the number of attributes was approxi- 
mately the same as the number of concept names. 

The studies found no difference in free recall 
resulting from the alternative sequences. They did, 
however, find evidence which they interpreted as indicat- 
ing that subjects more readily clustered the information 
by name rather than by attribute. ' 

Friedman and Greitzer (1972) conducted a study 
which was similar in most respects, but differed in that 
there were only three attributes and six names.' They 
found better recall and a higher degree of clustering 
for passages which were organized according to attributes* 

Conclusions ; Concept name versus attribtite . The 
reaearch on this topic is not sufficient to permit any 
substantial conclusions. The finding of better recall 
for attribute organization by Friedman and Greitzer 
contrasts with the other two studies. One difference 
in the design of these studies may have contributed to 
the conflicting results. Friedman and Greitzer used a 
relatively small number of attributes, as compared to 



the number of concept names ^ while the other two studies 
used about the sam6 number of attributes as names* Thus, 
it is possible that favorable sequencing might depend not 
on whether attributes or concepts are used as the basisi 
but rather on a choice of the structure which gives the 
smallest number of superordinate units/ 

Furthermore, these studies all used free recall to 
assess learning. As suggested in the introductory 
illustration, there. might be different purposes for 
instruction in this kind of material. The way in whidh 
the information is to be used might be of substantial 
importance in determining th<^ most Effective sequence* 
Thus I if the task required calls for identifying concepts 
on the basis of known attributes, the attribute orgahl- 
zation might be more satisfactory, while the converse 
might be true fpr tasks requiring an enumeration of the 
attributes given that the object is known. Clearly 
studies which inquire into^the {"(Effectiveness of this 
kind of organization should use 'dependent variables 
which are selected to reflect different task requiremehts. 

Content Independent Sequencing Principles * All of 
the preceding ordering principles have been dependent 
upon knowing the content ofrthe material to be sequenced. 
It is certainly to be expected that content would play 
a major role in determining the sequence. There are, 
however, a few ordering principles of sufficient generality 
that they can be considered independently of the content 
to which they are applied. We have identified three of 
these which we will take up in this section: (1) the 
serial position effect, (2) primacy and recency effects, 
and (3) sequencing based on the difficulty of the ' 
i^equenced items. 

Serial position effect . The serial position effect, 
a x^ell-^established and long-studied psychological 
phenon^enon, is defined in terms of the following para- 
digm: The subject is presented a list of items, generally 
Unrelated words, which he is subsequently asked to recall. 
Not uncommonly, the list is presented several times with 
some measures of recall during or following each presenta- 
tion. The particular method of measuring recall may vary. 
The typical finding from this paradigm is that the Items 
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presented earliest in the list are best recalled. Recall 
is also relatively good for items presented at the end of 
the list. However/ recall is . distinctly inferior for 
those items located in the middle of the list. The , 
superior recall for items at the beginning of the list 
is commonly called a primacy effect, while fhe relatively 
good performance at the end of the list is called a 
recency effect. These terms, however, have great6r 
generality and will be applied also ^n the next section. 

Most of the research on the serial position effect 
has been conducted with unrelated words. Howevieir, a few 
studies have used prose text with loosely related sentences 
as items. Deese and Kaufman (1957) found both compdnents 
of the serial position effect with such material. Prase 
(1969b) used the same type of material and found only ^a 
primacy effect. Rothkopf (1962) again used essentially 
the same material as did Deese and Kaufman, but found i)o 
evidence of either a primacy or a recency effect. He _ 
used a different dependent variable, however, essentially 
a fill in the blanks task, while the other two studies 
used free recall. It appears that the negative findings 
of this study may have resulted from the choice of 
dependent variable and may suggest that serial position 
effects with text material are more likely to )?e found 
when the test calls for behavior analogous to free recall. 

' Associated with the serial position effect is another 
well established phenomenon termed the "Von Restorf effect 
or more recently, the "isolation" effect. The paradigm 
for producing this phenomenon is exactly the same as ^ 
described above except that an item in ^the middle of the 
list is treated in a way which sets it off from the other 
items. It may be printed in a different color, printed 
in italics, underlined or in virtually any other way made 
distinctive. The consequence is that this item is 
recalled far better than would be indicated by the 
standard serial position effect. With unrelated items, 
this isolation effect has usually been associated with 
a decrement in the recall of items proximal to the 
isolated item, thus suggesting that there might be no 
overall gain in recall. With related Statements, however, 
"Cashen and Leicht (1970) found that the isolation effect 
was assoicated with improved recall of neighboring items 
as well as the isolated item, suggesting that an overall 
gain in recall had been achieved. 
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From the cibove studies/ several conclusions are 
fairly obvious and apparently consistent with common 
practice in preparaition of text materials^ First, 
the iftost important material should be presented at the 
beginning of an instructional segment. Second, it may 
be useful to place secondarily important material at the 
end of the presentation/ This observation/ however/ 
must be qualified: the recency effect may be a short 
term memory phenomenon which would hot appear with 
material to be remembered over a long period bf time. 
Third/ it is probably useful to employ isolation effects; 
that iS/ to ap^ly distinctive cues such as italics or 
underlining/ to facilitate recall of important items which 
must be located in the middle of the presentation^ 

Primacy and recency effects in persuasive communioa- 
tion and subjective probabiliW revision , in studies of 
persuasive communication/ subjects are presented with 
text material which might be expected to alter their 
attitudes or expectancies. Pretest and pgsttest attitude 
scales are administered to the subjects to determine the 
degree of attitude change with respect to particular 
items in the communication. Studies of subjective proba- 
bility revision present the subject with a fiL|Bquence of 
events which he is to use as evidence for up&uting his 
subjective probability about the way the events are gen- 
erated. 

While these two paradigms may be somewhat different, 
they both appear to apply substantially to the question of 
ordering effects in the change of subjective expectancies. 
Studies in this area have focused particularly on the 
relative effectiveness of primacy versus recency in the 
sequence of material. Generally/ when im^aediate recall 
tasks are not required in these paradigms/ a primacy 
effect is observed (Anderson and Barios/ 1961? Luchins/ 
1957a/ 1957b; Peterson and DuCharme/ 1967). However/ 
requirement of recall apparently enhances the possibility 
of recency effects (SchultZ/ 1963) • 

These studies/ to; the extent that instruotional 
materials might be regarded as havlnq^peyiu^a^^^ effects 
or an altering subjective ^roE'abili ties / lead to essen- 
tially the same conclusions as were found with the serial 
position effects. That is, the most important material 
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should, be presented first and the next most importcint 
material should be presented last* 

Sequencing t Item dif f iculty > It is generally 
accepted in the preparation of instructional material 
that a preferable ordering is to begin with the easy 
items and proceed to the more difficult* When viewed 
from the perspective of pisychological resea^rch, this 
principle poses something of a problem in that the 
definition of easy and difficult are somewhat unclear* 
In common sense terms, items are difficult for a group 
when relatively few people in the group get the items 
correct, or a subset of items is difficult for a subject 
when his percentage of correct responses is low. In 
neither case is difficulty solely a property of the item * 
Rather, it is a property of the item as presented to 
subjects. 

Thus, item difficulty depends to some extent on the 
backgrovind that the subjects have when they encounter the 
items. In different circumstances, the term easy may 
mean different things. In some cases, it may simply be 
that items are easy because they are familiar.. In other 
cases, they may be easy because they are prerequisites to 
a criterion which would be extremely diffi^cult if under- 
taken before acquisition of skills on the prerequisites. 
In still other circumstances, items may be easy for the 
objective reason that they require fewer steps to Solution* 
In addition to these alternative definitions of easy, 
there are alternative interpretations as to why an 
ordering from easy to difficult might be effective.. One 
interpretation is that learning acquired with easy material 
may be effectively transferred to more difficult items. 
Another equally plausible interpretation is that easy 
items lead to more frequent successes emd thus pijipvide 
more positive reinforcements leading to more favorable 
motivation conditions. 

In general both applied and basic research tend to 
the conclusion already assumed in practice, namely that 
sequencing from easy to difficult is more appropriate 
(Boutweli, 1971? Hivley, 1962) Moore and Goldiamond, 
1964; Terrace, 1963). However, further research is 
needed to delimit the locus of this effect and to thus 
provide , a basis for greater enhancement. 
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Interaction of Individual Difference Variables with 
Stimul us Sequencing * 

In a recent review of the literature/ Cronbach and 
Snow (1969) suggest that a given individual learns more 
easily from one method of instruction than from another* 
They aliio suggest that the best method differs from 
student to student # and that such differences are related 
to the characteristics of the student. Consequently/ 
optimal instructional conditions may require that the 
method of instruction/ and in particular/ the sequence 
of presentation be fitted to the needs of different types 
of students* In terms of experimentation/ this require-- 
ment calls for a search for aptitude by treatment inter- 
actions* ; 

There are two general methods one could use to fit 
the sequencing of materials to the needs of different 
types of students. First/ one could search for student 
characteristics which could be assessed in advance/ arid 
which could be shown to indicate a particular sequencing 
principle as being most favorsJ^le for students possessing 
that characteristic. In the absence of such a priori 
measurable characteristics/ one could measure""tne behavior 
occurring during the instructional activities and use such 
behavior as a basis for determining subsequent sequencing 
principles. Thus the student's performance on abstract 
items; for example/ might be used to determine whether 
he can handle abstract concepts easily or whether he 
needs concrete examples to supplement instruction on 
abstract topics. Using the behavior in the learning 
task to determine the instructional sequence rests upon 
the assumption that behavior in the instructional unit 
is the most relevant source of information about the 
students' needs and strengths in connection wj.th that 

Uillt. 

In this5 section r two major topics deal with attempts 
to link a priori subject variables to subject differences 
in response to alternative sequencing principles* The 
first assess the effect of individual differences in 
interaction with logidal versus scrambled sequences. The 
. second assess the effect of individual differences in 
interaction with inductive and deductive principles of 
sequencing. A third major topic in this section deals 
with the adaptive modification of sequences on the basis 
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of the subject* s response during training as this is 
achieved by branching versus fixed sequences in programmed 
^ instruction # 

Individual Differences ; Logical Verstts Scra^nbled 
Sequences * Two studies have indicated that the greater 
a student aptitude, as indexed by IQ measures, the 
less seriously is his performance affected by scrambled 
sequences of presentation (Tobias, 1973; Wodtke/ Brown, 
Sands, and Fredericks, 1967) . The results, such as they 
are, may be interpreted as indicating that sequencing is 
probably more important for optimal performance with 
students of lower scholastic aptitude. 

Individual Differences : Inductive ver s u s ^ D e due t i ve 
Sequences , Two studies seem to suggest that some subjects 
would be better trained with inductive sequences, while 
other subjects might be more effectively trained with 
deductive sequences. A study by Orton, McKay and Rainey 
(1964) led them to conclude that if a learner is of low 
aptitude, he is more likely to profit from an inductive 
order of presentation, while if he is of high aptitude, 
he is more likely to profit from a deductive order of 
presentation, 

A study by King, Roberts and Kropp (1969) constituted 
an effort to identify and validate a priori measures of 
inductive and deductive aptitude. Several potential 
measures of aptitude were used. One measure of inductive 
aptitude was the word grouping sub- test ftom the Primary 
Mental Abilities test, grade level four to six (Thurstone 
and Thurston, 1962). The inference test from the 
California Test of Mental Maturity, level two (Sullivan, 
Clark and Tregs, 196^) was ^selected as a measure of 
deductive aptitude* Results indicated a modest correlation 
(0,37) between the test of inductive aptitude and perfor- 
mance on inductive sequences. Similarly, a modest corre- 
lation (0.37) between the deductive aptitude test and 
performance on deductive sequences was reported. Neither 
of the measures was correlated with performemce on 
the opposite kind of sequence. Thus, there was some 
indication that these measures were marginally valid for 
predicting performance in their respective tasks, 

Several other studies have produced equivocal results 
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In relating 4ndividuial differences to inductive and 
deductive sequences; Tallmadge and Shearer (1969) , Koran 
(1971), Koran (1972) ;Kruinbolt2 and Varboff (1965) • In 
view of the$e equivocal results and the relatively weak 
evidence provided by the two studies cited above /it is 
clear that no conclusions should be drawn regarding this 
topic. There is little to be said except that substantially 
more research is required. 

Bra[nchincf Versus Fixed SegtfettCiSs in Prograirimed 
Ihstructxon . If it is difficult to establish a pyiorl 
individual differences which can b0 used to predetermine ^ 
the appropriate sequence for individuals / perhaps it is^^^^^ 
possible to use information developed during the iristruc-^ 
tional process to choose among alternative sequences aiid j 
so adapt the sequences to the student's need on i:ea;i 
time basis. In principle/ the use of branching tdchniqu^^ 
could allow such art adjustment. For example, if there / 
really we individuail differences in the ability to use 
inductive and deductive sequencing/ a computer supervised 
instructional program ml^ht begin with say/ a deductive 
principle and on the basis of the subjects' sudces^/ 
either continue with such a principle in further ins true-^ 
tion or shift to an inductive sequencing. The obje<5tives 
of branching used in actual research, however/ have been 
somewhat more pedestrian. 

Bremching has been used principally to provide 
remedial instruction on the basis of evidence that the 
student is failing relevant test items, or to bypass an 
instructional unit on the basis of evidence on a pretest 
that the subject does not need instruction on this 
material. Early studies of this topic generally fail 
to show a differential effect associated with branching; 
Silbermart/ Melaragno/ Coulson/ and Estavan (1961)/ 
Coulson and Silberman (1961)/ Roe (1962), and Campbell 
(1963) . I 

Subsequent studies have produced somewhat more 
favorable results. The Coulson group in a third effort 
(Coulson/ Estavart/ MelaragnO/ and silbermart/ 1962) 
found better performance on a criterion test in a group 
which had been instructed with branching sequences . as 
compared with a group using fixed sequences. In contrast 
to the previous two studies of the Coulson group/ this 



thir4 study used, as Branching criteria, both erroi^s 
and th6 student evaluation of his own learning process, 
The earlier studied with negative resultsf had used only 
errors as branching criteria. / 

It may also be noted in connedtion with tW third 
etudy of the Coulson group that the subjects in the 
branching condition used fewer items and tpokr if any- 
thing, less time to complete the unit (no significant 
differences were found in^ the time required) . A later 
study by a member of the Coulson group, Me* laragjio C 1967) , 
also found results tending to indicate greater teaching 
effectiveness for a branching sequence. This study 
demonstrated approximately equal performance on the ' 
criterion test, but found that the branching condition 
required less time and fewer items to complete the unit. 
The results of these two studies are to some extent 
complimentary since it Would be reasonable to expect a . 
trade off between amount learned and time spent. Thus, 
depending on how one constructed the unit and upon the 
branching criteria used, students might either learn 
more material in the same amount of time or the same 
amount of material in less time. 

Caution, however, should be taken in interpreting 
these studies emd others of the same paradigm, Branch- 
ing is the variable intentionally pianipulated, but it 
tends to Influence the number of items used by the 
subject. The tendency seems to be for brahohihg programs 
to result in fewer items presented to the subject, thus 
the branchinrr method is confounded with a reductioh in 
the number of items. If the subjects in , the branching 
condition spend as much time as is allowed for the fixed 
sequence condition, they havis more time per item. ' 
^Iterriatlvely, they may spend less tim^ On the sequence 
as was found in the Melaragho study; In either case, 
the €if fects of the branching variable per} se are 
confounded with the eif fects of r^sduoing the nuniier of 
items, It is not clearly established in these studies 
that branching was required to prdduce the results . It 
is logically possible that a fixed sequence with the 
right items dropped would have proi^luced the same results 
as did branching. . 



If i,t is supposed that branching sequences may be 
better than fixed sequences, one might also ask whether 
branching sequences are better than learner-controlled 
sequences. Clearly the learner control method also 
offers the possibility for adapting tl^fe sequence to the 
needs of the learner. One st\jdy/ Atkil\son (1972) , address- 
ed this question. Atkinson investigated altema- 

. tive methods for optimizing the learning of a German- 
English vocabulary. One method permitted the subject - 
to choose on each trial the next' item to be presented 
to him. Two ojther methods were based on a mathematical 
learning model and utilized learner response history in 
determining oh each trial which item was to be presented 
next. On a criterion test, the subjects under one of 
the computer controlled strategies achieved the highest . 

i level of performance. Based on this result one may 
conclude that \inder some conditions Experimenter controlled 
branching is more effective than pure learner control. 

The above studies suggest that bipanching sequences 
may yield detectable improvements in performance or 
reduction in time required to complete the unit. Some 
caution in accepting this conclusion should be exercised 
as indicated. There is a general problem with research 
in this area because units of programmed instruction are 
generally quite jef recti ve, at least as measured by their 
own criterion t^t. If the average performance on a 
criterion test following a fixed sequence of programmed 
instruction is quite high, there is relatively little 
room for demonstrating subsequent improvement. When a 
branching sequence is introduced, in fact, the most 
likely place in which improvement , could be found is in 
the reduction of time resulting from a reduction of the 
number of items. But, as noted abov^ branching is not 
the only way in which one could reduce the number of 
items. If a group of subjects were presented an instruc- 
tional unit with branching options, one could tally the 
frequency with which each optional item is used, and on 
the basis of that, drop out the least frequently used 
Items to produce a shorter sequence having the same 
average number of items as used in the branching sequences. 
A comparison of such a sequence with branching sequences 
would be required to establish that branching itself, as 
distinguished from reduction in the number of items, is 
the source of the results found above. 
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iSeyond this, there is a need for research to esta- 
blish cost-effectiveness parameter's. It is not sufficient 
to know that branching offers certain advantages. One 
roust also know the magnitude of the time saving, for. 
example, in order to determine whether it is worth the 
additional cost in terms of preparation effort and 
computer programming to utilize branching. 

It should also be noted that the possibilities of 
branching have never been fully explored. As indicated 
at the beginning of the discussion, studies of branching 
have really been studies of sequencing only in the sense 
that the brajiching introduced remedial instruction when 
called for and skipped over material when the students* 
performance indicated no need for instruction on that 
material. In other respects, the sequencing was in 
fact some a priori sequence determined, at the time the 
instructional iraterial was prepared. Some of the ordering 
principles reviewed earlier in this paper could be incor- 
porated into a branching strategy which would have the 
potential for adapting the instructional sequence to the 
needs of the subject over some substantial range of 
ordering principles. If sequencing strongly interacts 
with individual differences, this may be one of the most 
promising avenues for discovering such a;i effect and 
utilizing it for practical inatruoLional purposes. 

Sequencing of Supplementary Instructional Material , 

Instructional material can be viewed ds composed of 
two components. One component includes the bare bones 
of the information to be presented, sentences or freanes 
which directly convey the information that will be required 
subsequently on a criterion test. Given just this core 
material, an extremely good learner With sufficient 
effort should be able to extract all of the information 
he needs for a high score on the criterion test. 

The other component includes material which is 
provided in the apparent belief that it will facilitate 
learning. Such material is not essential; it is redundant 
in the sense that it repeats information provided in the 
core components, and its function is presumably to interest 
the student, to organize the material for him to highlight 
importemt points, to cause him to recall material, ahd so 
forth. This supplementary instructional material can be 
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subdivided Into three categories: advanced organizers i 
questionsi and reviews* In this section r we will deal 
with each of these subcategories* 

Fac i 1 i t at ing r xprwangb t - Advahced Orgahl zers , 
Advanced organizers ar6 tntroductpry material at a high 
level of abstraction/ generality i and inoltisiveness. 
They are designed to provide an overview of t]he materials ' 
to be learned in terms which are familiar to the student. 
Itesearch on this topic has typica 

effectiveness of advanced organizers with a historical 
intrpductiort of appro>cimately equal lengths ^results ^ 

indicate (Ausubel/ 1960; Ausubel and Fitzgetlad/ 1962) 
Scandura and Wells / 1967) that advanced organizers 
enhance retention as measured by a subsequent criterion 
test* These reassuring re^ultB ^Jonfirm, that the faii^ly 
general practiqe of preparing instructional materiais 
with an overview in front is, indeed, scientifically 
justifiable and should be continued. 

F acliitating Performance ^ QaestionS i Ouestions 
may be posed before or aa^ter the'^preseritation of an 
instructional passage. Such questions ntay be very 
general in nature, or they may focus upon piartlcular 
items in thd passage. Geneiar questions might more 
properly be viewed as an alternative form of advanced 
organizers. More scientitic questions have been used in 
the research discussed here* A principle purpose of 
this research was to determine whethet such questions 
would facilitate criterion performance as compared to 
instruction without the questions. A second purpose 
was to determine the relaitive effects of placing the 
questions before the instructional material as compared 
with placing them after it. Brunlhg (1968) , Prase (1969b) , 
Rothkopf (1966) , Rothkopf and Blsbicos (1967) , have 
conducted studies on this question. The results have 
also been reviewed by Frase (1970). 

The findings of these studia« indicate that whether 
questions are inserted before or after the passage, they 
nevertheless facilitate criterion performance* There is 
a difference in the effect of placement/ however. 
Questions inserted prior to the passage tend to favor the 
acquisition of materials specifically relevant to the 
questions. Material not relevant to the questions is 
hot retained as well as it is when the questions are 



omittecl. Thus, there wotiild appear to be a 4:rade off 
effect produced by using questions in advance of the 
instructional passage . 

Questions provided after the ihstiuctional pas 
have a more generally favorable effect, E?rovided that 
a sequence of such passaged and subsequent ^^i^^^^^ is 
presented. Under these circumstances, the presence of, 
the questions facilitates the acquisition both of , 
material relevant to the questional artd of material 
untelated to the questions. ; 

On the basis of 'the above 'studies, it appears that 
questions are useful as supplementary material ; Questions 
prior to the instructional passage may be useful for 
emphasizing or pointing out particularly important items 
to be learned. Questions presented after the instructional 
passage may not oi)ly provide rehearsal on the item 
associated with the question, but may also provide 
circumstances which reinforce effective learning behaviors. 
Such questions could, thereby, lead to a geheral improve- 
ment in learning on the part of the student* Such . . 
questions may also serve to indicate to the student the 
kind of material he is required to learn for 5UC<?ess on 
the criterion test. 

Facilit'tting Performance: Reviews . It is generally 
supposeTIn 'the preparation o^ instruptiohal materials 
that reviews of some sort ate useful. Research by Gay , 
(1971) supports this view and furthermore indicates that 
in presenting more than one review r it>is useful to / 
distribute the reviews over time,. Other evidence^ 
(Ausubel and Youssef, 1965) tends to cOnfinn this con-^ 
elusion, which is also consistent with the genexral 
finding of massed versus distributed jpractibe cited 

earlier in this report. 

Describing Information Structure . 

In the introductory section of this report, we 
discussed the properties of instructional content that^ 
might influence the sequence of presentation. We noted 
that the critical aspect of instructional material, 
which may bear upon this question, is that of interr 
dependence or relationships among the items to be taught. 



We will designate the set of relationships among the 
concepts in an instructional unit as its structure. 
The structure of teaching materials can be subdivided 
into two general categories, the semantic structure and 
the teaching structure • 

The semantic structure of a unit is composed of the 
conceptual interrelationships which are inherently part 
of the material to be learned. Examples of these 
relationships are; (1) temporal, (2) spatial, (3) 
attribute-concept, (4) part-whole, and (5) subset- 
supersets Most of these re l^itiont^hips have been 
mentioned in the preceeding sections* Two of them, 
hierarchical structures (composed of subset-superset 
relationships) and concept-attribute relationships, 
were discussed at some length as potential bases for 
particulair sequencing principles. 

Teaching structures are sets of relationships among 
concepts which are introduced specifically for the 
purpose of improving the effectiveness of instruction. 
Illustrations of teaching structures are rule-examples 
and analogies. A, third relationship, which might some- ^ 
times fit under this category, ic that of prerequisite- 
criterion. The rule-examples relationship has been 
discussed in an earlier section under the heading of 
inductive versus deductive sequencing. The prerequi- 
site-criterion relationship was discussed in connection 
with the sequencing of hierarchical material. 

Information structure may be important in ordering 
in at least two ways. First, an instructional unit may 
be represented by a single pure structure, that is a 
structure containing only one type of relationship. 
For example, a pure structure may be involved in teaching 
an individual ^out the capabilities of a set of weapons. 
In this instructional setting the only relationships 
between the weapons and their capabilities are ones of 
concept-attribute. Once this structure is discovered 
(in this case it is fairly obvious) then empirically 
devised principles of ordering concept-attribute 
structures can be employed (see the section on Sequence 
Organi2;ation: Concept Name Versus Attribute, page 37,^^ 
for further details). This example can obviously be 
extended to any instructional situation, where there is 
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primarily one type of relationship between the items to 
be learned/ and where principles of ordering material 
with this type of relationship are w^ll specified. The 
basic problem is to develop technique's for discovering 
the nature of the underlying relationship in a pure 
structure so that appropriate sequencing principles can 
be employed. 

A second way in which structure might be used to 
determine optimal sequencing lies in the possibility 
that principles for deriving optimal sequence from any 
known structure might be developed. This latter consi- 
deration becomes particularly important when we recognize 
that many instructional units fail to constitute pure 
structures of any single kind. Rather, they tend to be 
compounds in which several different kinds of relation- 
ships exist among the concepts. 

For example/ in an instructional unit dealing with 
basic concepts in physics we might find such concepts 
as matter, atom/ electron, nucleus, valence, free electron/ 
bound electron/ and conductor. Atom has a part-whole 
relationship to matter; i.e./ matter is composed of atoms. 
Nucleus and electron also have a part-whole relationship 
to atom/ and they are themselves subject to a spatial 
relationship. The concepts free and bovuid have an 
attribute relationship to electron. Valence has an attri- 
bute relationship to atom. Free electron and conductor 
have multiple or alternative relationships. In one 
sense/ a free electron is part of a conductor* But that 
does not fully express the relationship since an atom is 
also part of a conductor. In fact/ free electrons are 
also related to conductor as a defining attribute. That ' 
is, a conductor is a substance which has many free electrons. 

These physics components described provide an example 
pf a compound structure (multiple types of interrelation- 
ships). With this type of structure it would be necessary 
to fully describe the relationships between concepts and 
to produce em idiosyncratic ordering taking into account 
the nature ctnd strength of these relationships. Clearly 
what is needed is a means for describing such a structure 
and a technology for deriving an optimal order from it. 
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V ' There is still another reason for seeking a capability 

of describing informatio;! structures; better methods are 
needed for assessing comprehension and learning. The . 
semantic structure of a teaching unit is inherently part , 
of what is to be taught. Indeed, it would appear that 
with regard to conceptual material, we may distinguish 
between elementary facts and semantic or conceptual 
structure, if so, we would suppose that when a person 
is said to 'know some of the details of a unit i but not 
to. have comprehended the entire thing, we meart th^t he 
has not acquired the semantic structure (the set of 
relationships among itenis). In other words, it may be 
that when a person comprehends conceptual materiai# he 
is representing it to himself in a way that is cbnsistent 
with a generally accepted semanv'^ic structure, j Thus, we, 
might use methods for describing semantic structure, not 
only as a method for gtequencin^, but also as a ,itvethod 
for a8sess|na^,the\ adequacy of cpmprehension over and 
above the/tf^^^nt to which detailed items have been leairited. 

We may identify three general techniques which might 
be considered approaches to the description of information 
structures. These are.* learning hierarchies of the ; 
prerequisite-criterion type, structureal analysis, and 
multidimensional scaling. 

Learning Hierarchies . Learning hierarchies were 
discussed previously in the Stimulus Sequencing section. 
The general supposition underlying this approach is that 
learning is cuimulative. It is assumed for any given 
criterion task, there are prerequisites which can be 
identified and which must be mastered before the criterion 
task ccin be accomplished. EXcimples of theoretical and 
empirical work in t'his area are: Gagne (1968, 1970) , 
Resnick (1967), Bloom, Hastings and Madaus (1971), and 
Merrill (1973). A review of theoretical issues in this 
area is provided by Okey (1973). 

As characterized by Okey, the standard procedure for 
specif ing a learning hierarchy is to work backward from a 
terminal task stated as a specific performance outcome. 
The person developing the hierarchy asks himself, "What 
^ would the learner have to know to learn the task most 
efficiently?" In answering this question, one or more 
prerequisite tasks may be identified. This same question- 
ing process is applied to the tasks identified in response 
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to its first application and so on recursively until the 
tasks being identified are skills already acquired by the 
learners/ The rationale for this approach has been set 
forth primarily in- the context of mastering such tasks 
as arithmetic and algebra* It is of course/ generally 
acknowledged that clear prerequisites exist in such cases ♦ 
However, such a clear structure probably does not exist 
in most other bodies of instructional material. 

According to Okey, the way to validate a learning 
hierarchy is to determine whether it describes the actual 
learning sequence in a large percentage of the learners. As 
a matter of fact, siich a criterion is necessary but by no 
means sufficient since it does not provide for assessment of 
the critical attribute of a prerequisite; a task which must 
be mastered before the subsequent task can be performed. 
Merely to determine that tasks are mastered in a particular 
Sequence confounds the prerequisite-criterion relationship 
with the easy-difficulty variable in that a task mastered 
earlier may not be a prerequisite for a later task, but may 
merely be easier to learn than the later task. Thus, there 
is some reason to doubt the adequacy of validation of the 
learning hierarchies as reported by Okey. This apparent 
validation may merely reflect the investigators' ability to 
order items from easy to difficult. Such an ordering, of 
course, could in itself constitute a principle for ' 
instructional sequencing and, indeed, has been discussed 
in the section on stimulus sequencing. However, such an 
approach would not constitute the utilization of a 
prerequisite-criterion structure. 

Another difficulty with the learning hierarchy approach 
is it rests upon the assumption that strong prerequisite- 
criterion relationships exist in the material, and the 
specification of these relationships is a useful way of 
describing the structure and seeking the relationships. 
Even if it were generally applicable, the learning 
hierarchy approach would not in itself result in any 
general principles because the notion of a prerequisite 
does not embody any general principle other than an 
assertion of optimal order. If one knew, for example, 
that all conceptual hierarchies are best taught in a 
particular fashion, this principle would apply to every 
new conceptual hierarchy encountered. In the prerequi- 
site-criterion framework, however, each new criterion 



task is a new challenge to identify prerequisites. In 
factf any more general procedure for identifying an 
optimal ordering is an alternative method for specifying 
prerequisite-criterion relationships r if we take the term 
prerequisite in a less than strict sense. 

In addition to these disadvantages the learning 
hierarchy approach rests upon the skill or art of the 
developer to identify genuine prerequisites • The pro- 
cedure is not replicable and is not readily subject to 
improvement, except by training of developers, and in 
€my case is likely to be very expensive. 

Structural Analysis * Information structures may 
also be identified by structural analysis methods. Three 
researchers, Fredericksen (1971), Frase (1969b), and 
Crpthers (1970, 1971} have developed methods of describing 
the semantic structure of text passages by separating the 
structure into underlying components representing semantic 
content and superficial components corresponding to style* 
The semantic component is represented as some form of 
hierarchy with the higher level elements corresponding to 
the general meaning of the passage. The nature of the 
relationships between elements are specified in this 
analysis. 

The procedure for the analysis is far too elaborate 
to describe here. It is not explicit or replicable, but 
must be accomplished by persons already skilled in its 
application. Moreover, the analysis has been applied to 
only a few passages thus far. The intent of current 
structural analysis investigations is to explore its 
utility and induce an algorithm which can then be made 
explicit and general.' If that objective is accomplished, 
this method is extremely promising. But until it occurs, 
the techniques is more art than science and would be far 
too expensive for any practical application. 

Multidimensional Scaling . Multidimensional scaling, 
a recent analytic technique which has come to prominsuice 
in studies of perception, has also been proposed as a 
methodology for defining information structures (inter-- 
relationships among concepts). The procedure was 
originally developed for studying how hiomans perceive or 
interpret relations among complex collections of objects 
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or events (Torgorson, 1958).. A revievf of more recent 
applications is provided by Zinnes, 1969. 



As indicated earlier, an information structure is a 
set of interrelationships among concepitual units. When 
the relationships are of one kind as in a ^ure structure^ ^ 
the identification of such relationship is generally not 
difficult. If, however, there exist many types of 
relationships in the same body of material, identification 
and specification of those relationships (as with the 
compound structures described earlier) may become 
extremely complex and even impossible without some 
technological assistance. 

At this point, multidimensional scaling offers a 
useful mechanism. It is certainly possible to obtain 
from people judgments aboat the extent to which pairs of 
items are related, tsdcing each pair at a time. Such 
pair-wise comparisons may reduce the problem of describ- 
ing the structure to a manageable size from the standpoint 
of the judge. The set of pair-wise comparisons can be 
analyzed by multidimensional scaling procedures in such 
a way as to recover an organizational framework which can 
account for the judgments. The distance relationships 
in this framework offer a possible description of the 
information structure used by the. judges assessing the 
relationships. 

Thus, with material of unknown information structure, 
it is possible to obtain judgments from a collection of 
people knowledgeable about the material and to analyze 
these judgments in a way which produces a description of 
the information structure. Multidimensional scaling 
techniques not only allow for the inference of a structure 
on the basis of pair-wise comparisons, but they also permit 
the creation of an average structure which integrates the 
judgments from any desired number of experts. The result, 
under favorable circumsteuices, would br a consensus 
structure which avoids the idiosyncrasies that might be 
associated with any particular individuates viewpoint. 

As originally developed, multidimensional scaling 
techniques we le intended to permit the description of 
structures of stimuli in which the stimuli had multiple 
interrelationships. For example, the perception of 
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similarities between random shapes varying on a number 
of dimensions (e«g. / symmetryi area, and jacfgedness) 
has been explored with xnultidlmensional scaling techniques. 
It has subsequently become clear that the techniques could 
also be used for describing interrelationships among 
cognitive urtits, as well as^r pevrceptual units. Clifton 
and Odom (1966) used multidimehsiorial scaling methods to 
study propositions derived from psychoiinguistice. The 
stimuli in this case were sentences which differed by 
standard gr^ammatical transformations (i.e. i combinations 
of passive/ negative , and question transformations) . 
Subjects in this experiment were asked to make similarity 
judgments on all possible pairs of stimulus sentences. 
These judgments were then submitted to the INSCAL program 
(Carroll and Chang, 1970) for multidimensional scaling. 
Prom a psycholinguistic standpoint it would be ekpectedl 
that the subjects would perceive the sentences as yaryin^f 
on three dimensions corresponding to the three classes of - 
trans formabiohs used. The conceptual spaces pr6duced by 
the INSCAL program did indeed contain the three expected 
dimensions. Further, the locaitions of the sentences in 
the conceptual spaces were congruent with theoretical 
expectations. 

Dansereau/ Fenker and Evans (1970) had subjects make 
judgments ab|5itut stimuli stored in memory. The structures 
recovered by the multidimensional techniques v^re similar 
to those obtained when the subjects were judging the 
stimuli themselves r thus indicating that scaling methods 
are applicable to judgments of relationships stored in 
memory as well as to relationships yisibie during percep-^ 
tion. It is, therefore, possible to use multidimensional 
scaling to tap the internalized cognitive structure of 
an expert in a particular area. 

Wainer and Berg (1972) used a multidimensional 
scaling technique to infer an information structure 
employed by students judging literary works. The students 
rated short stories according to their similarity, and 
subsequent multidimensional scaling analysis of the results 
produced two well defined dimensions which Were readily 
interpretable in a literary sense. The authors concluded 
that this method might be suitable for evaluating students* 
understanding of literary works and for determining the 
effectiveness of instruction. 
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Multidimensional coaling appears to offer substantial 
advantages for producing descriptions of information 
structures. It is not limited in application to pure 
structures alone, but is suitable for compound structures 
(such as, the semiconductor ^ atom, and electron structure 
described earlier) , regardless of whether the relation- 
ships among concepts are Icnown or not* Furthermore, it 
constitutes an explicit procedure for producing an infoi*- 
mation structure, a procedure which can be replicated with 
other judges and v;hich should produce similar results from 
different sets of judges. The judges themselves need no 
particular training in operating with the assessment 
technique, so that, while the information structure is 
subjective (as it must inevitably be) , it is not the 
subjective judgment of a single individual or the result 
of a training technique. Multidimensional scaling can, 
thus, be regarded as a technology rather than an art, 
and one which can be applied relatively inexpensively. 

Derivation of a stimulus order from ft structure 
produced by multidimensional scaling would still be an 
art at this time, but since the structure can be specified 
explicitly, it is also pos3ible to propose and evaluate 
explicit procedures for deriving an order from the 
structure (a preliminary attempt at deriving stimulus 
sequences is presented in Annex B) . Thus, it is possible 
that the multidimensional scaling could be used to produce, 
not only an information structure, but also a specified 
ordering ir* an explicit and standardized fashion. If 
successful, this sequencing technique would be replicable, 
and applicable to a wide variety of instructional 
materials. 

Moreover, since the responses used in the scaling 
require no particular training, these responses can also 
be obtained from students, as suggested in some of the 
studies mentioned previously. Part of what a student is 
supposed to acquire as a result of instruction on cpncep- 
tually complex material may be a representation of the 
interrelationships among Wncepto; that is, the information 
structure, if that is so, it would be possible to measure 
the extent of agreement between the structure recovered 
for a given student and the consensus structure of the 
experts » That extent of agreement might be taken as a * 
measure of the student's conceptual grasp of the material. 



If this measure should prove valid, it would offer not 
only a general measure of the student '.s grasp f but a 
specific indication o^^rhere the student was deficient. 
The extent to which the student matched the consensus 
inforthation structure could be assessed on each diioension 
of that structure, and if he were found to be deficient 
on a particuletr dimension, that information might be used 
to decide on an appropriate remedial training activity to 
improve his utilization of that particular conceptual 
dimension. For example, in the context of the Clifton and 
Odom (1966) transformational grammar study/ if the 
conceptual space derived via multidimensional scaling 
for a particular subject indicated that he used only 
two dimensions in making his similarity judgments (e^g. , 
dimensions corresponding to negative, and passive transfor- 
mations) rather than three , then training on the third 
dirrtension (in this case, the question transformation) . 
would most likely enhance his perceptual processing in . 
this situation. > 

Recommended Directions for Future Research . 

Specific conclusions and recommendations have been 
made at the close of most of the sections^ A fpw major 
recommendations stand out in a review of these specific 
recqsuafendations. 

Description of InfQrmation Structures . Mu(?h more 
attention should be paid to the development of procedures 
for describing the information structure and relating 
the ordering of instructional materials to such a struc- 
ture in the context of research. Information structure, 
as described on page 51, is the set of interrelationships 
among the concepts, or items, to be taught in an instruc- 
tional unit. These interrelationships among concepts may 
be of a variety of types: temporal, spatial, concept- 
attribute, part-whole > superset-subset, and ri\le-example. 
In a pure information structure all interrelationships 
among concepts are of the same type (e.g., concept-attri- 
bute). In a compound information structure there are 
two or more dif iferent types of interrelationships 
composing the structure. 

For the most part, the basic strategy for' relating 
content to ordering has been to identify or impose a pure. 
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information structure upon the materials, and then to 
apply an ordering principle to that structure. The only 
alternative to this procedure appears to be the use of 
'expert opinion to produce an ordering on the basis of 
thi subiec?i?e and^unknowh principles used by the^ expert. 
Thus, it appears that explicit 

ordering principles must be derived by identify ing _ 
ciasSes^of information structure^ (e.g. , ^°"°«P^-^ttribut^^^ 
relationships) and testing the effectiveness^of ^standard 
drdeting principles (e.g., organization by concept or by 
attribute) . 

■ ' ■ ^' ■ 

A major limitation to this strategy is that simple , 
and DUre information structures mjiy be relatively rare in 
p?acticll instructional units. Thus, while t^e importance 
of this information structure as a basis for studying^ 
ordering processes must surely be acknowledged, methods 
Lst be developed which allow for the description df, 
information structures as complex^as those that are found 
in typical instructional unit^. Furthermore, explicit, 
obiec ^Ive procedures must be developed which allow the 
specification of possibly appropriate orders from the 
knowledge of the information structure. Finally, the 
exolicit ordering procedures must be evaluated for 
effectiveness in practical instructional contexts. 

D'»"'*l'^««'«nt Of Dependent Measures . Associai;ed ^ 
with this researc frit will be essential to develop and^ 
validate dependent variables which are sensitive to the 

- learning of conceptual material. Tests which primarily 
mlasSre^he student's recall of in<5ivldual facts may n^^^ 
adeauately reflect his mastery of the conceptual aspects 
of tSe material (that is, the interrelationships between 

'concepts). If conceptual mastery is desired, separate 
tests may be needed. Tests which can be validated by 
more generally acceptable measures of conceptual mastery, 
such as, performance on an essay test, can be used. _ 
Measures based 6n multidimensional scaling may also be 
applicable foi; these purposes. 

Effects of Individual Differences . Finally ' . 
attenlrlrn^eeri tTbi-glv^n- to individual differences 
and their interaction with" instructional variables such 
a« ^-^A^Y-ityft Cin the basis of the present review, it 

iyitl lLt ?he research base for conclusions about 
ih-e i^or^ance of Indf?idual differences is distressingly 
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weak. Thus, the evidence, cannot be cited as demonstrating 
majou individual difference effects in interaction with 
sequencing. Nevertheless, there ie a Wideopread, if not 
soientiflcally substantiated belief among teachers; that 
substantial individual differences exist with respect to 
resi^bnsiveness tb alternative teftchi|ig. methods. I| such 
differences do exist, they must H tak^n • into account ' ^^^^^^ 
adequately in . the .execution of researoK on this iopioV^ - 
Otherwise^ individual differences will obscure th/a^feaW:- 
Of instruotionil' treatft«erits ;up6?> performailce: by conta«-i?ni^- 
buting relatively significant veirianc^ . to the error teiSK^- - 
and, thus^ redube the likelihood, of detecting ir^e tr^at'4V:J;> 
iwirit^effedts.^Ae a first Hth this 'M^A 

problem, latterttion sh0ui4.be given ^6: int'roducing.r&peaCedi- 

designs;;into this kind of : Research i - Beybhrtt^^ 
subject variables shbuid be sought which coul^' predict4;rinV ? 
responsiveness to partioular ordering principles . , In " ! c.^? 
practi$>al appUoations , branching techniquf^S in progifammed 
instrubtions and pretests, prpyiding diagnostic informatioij.: 
aboMt points of familiarity for the individual student^ 
may prove to be useful in adjusting instructional sequences 
to individual needs. ' : , 



CHAPTER II 



EMPIRICAL DEVELOPMENT 



The reviev^ and aynthost? of the literature ahovfed 
that the sequence in which inetruotionaX material is 
presented may Influence the eff^ctiv0ness of ; InstifUctipn , 
as measured by the achieveirterit level or by the time 
required to reach a specified achievement level* Accord- 
ingly, if the optimum sequence of a particular body of 
material were known , training programs could probably 
be made more effective and more efficient. The li^^rature 
on the effects of sequencing, however, is replete with 
conflicting studies. Sec^uehce effects are often found, 
but there are enough exceptions to suggest that we do not 
yet know all of the conditions which are necessary to 
produce sequence effects or use them constructively in 
the design of ins tructibnal material. 

^ Chapter I indicatisd that there are at least two 
major reasons for the lack of definitive conclusiohs on 
the effects of instructional sequence. 

(1) There .is presently no systematic method for 
producing potentially optimal sequences. If WS assume 
that the underlying structure of the body of material - 
the interrelationships' among the concepts is a major 
determinant of the optimal order of presentation (as , 
discussed in the Information Structure section of 
chapter 1) > then what is needed is an objective and 
broadly applicable method for* describing this sttuctu^^e. 

(2) Individual differencea may strongly interact 
with instructional sequencing. Thus , there may be no 
single optimal sequence, ratheir there may be several \ 
sequences which are optimal if fitted to the appropriate 
individual. Most of the reaeairch on the effects of 
sequencing has not adequately taken into< account the 
potential role of individual differences » such an omission 
could grea£t3.y attenuate the apparent effectlV6ne(8S of 
sequences. Ideally* the information sequences should be 
tailored to the individuals heeds, current preparation, 
and perhaps his learning information'-prbcessing habits. 
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The purpose of this research program is to study 
the effects of sequence in a coherent fashion # taking 
into account the above mentioned difficulties. In 
particular, this program has been designed t 

(1) To investigate the utility of multidimensional 
scaling as a miathod for describing the underlying strud^ 
ture of Air Force instructional material^ and r consequently 
to investigate its utility as a basis for deriving poten- 
tially optimal sequences^ 

(2) To determine whether there are interactions 
between information sequence and measures of intellectual 
ability; . _ ■ - ' ' ■ ^ -/^ - • v^^^^ 

(3) To assessithe effectiveness of tiiese sequen^^ 
with two modes of presentation/ " Verbal artd tolctoxlal "V : 
and two levels of dif f i cul ty of the ins tr uo tlona 1 i : ; 
material; both of these might be escp^ 

strongly with* individual differences. 

(4) To assess the interrelationships and sertsitlvity 
of several measures of comprehensipnV including muitidi^n-^ 
sional scaling. 

In this porijion of the report we will present! 

(1) An overview of the major study to be conducted 
in Phase II of this research program. \ 

(2) A discussion of the stimulus materials and 
dependent measures which have been developed for use 
in the pilot studiesi and which will forfti the basis for 
the selection of materials to be used in the main study. 

(3) A detailed report of the pilot studies results. 

Overview of the Major Study . 

The major study to be conducted in Phase II' of this 
research program is designed to fulfill the purposes 
enumerated previously and/ thus/ dispel some of th6 
uncertainty ad>out the effects of information sequencing 
on instructional success. It is planned that this 6tudy 
will use one hundred and eighty Air Force ROTC students 
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as dubijedta in a fully crossed 2 by 2 by 3 design with 
15 subjects pei cell. The independent variables will be « 

(1) t\c>d^ Qf breseh tation ; " verbal versus teiotorial " » 
The same instructional content will be presented in tyo 
different forms ; one emphasizing verbal instruction in 
the f oxm of printed text> .the other making maximum use , 
of pictorial and graphic presentation. 

(2) Difficulty of in Str uct icn^ 1 material . Two Air 
Force ins tructional packages differing in the e age of 
acquisition will be used. The fact that these packages 
differ in level of difficulty has bfien established empir- 
ically in one of the pilot studies. ■ 

(3) Stimulus sequence . The instructional packages 
have been decomposed into small units with each unit 
bearing upon a particular Concept. The units from' each 
of th6' instructional paCka'Ses will be arranged in three 
different orders. One order will be that used in the 
original Air Force instructional package, the other two 
orders will be derived from the muitidimensiOnal scaling 
technique . 

Xn addition to the above independent variables # 
measures of each subject's intellectual ability will be 
corifelated with performance on the experimental task , so 
as to determine the extent to which this measure of 
individual differences interacts with the independent 
variables in determining performance in the experimental 
■ task i ■ ■ \' ■^'■■■V'' r 

The stimulus materials and dependent variables fpr 
tfiis major study have been assessed- and inqdified in a- 
series 6f three pilot studies. Prj,or to a discussion of 
the resuits of these studies, the 4^iinuli and dependent 
measures will be presented* 

Stimulus Materials . ' 

In this section we will discuss t ' 

(1) the selection of the instructional packages and 
Uieir conversion into pictorial ahal^^ 



(2) the description of the underlying structure of 
these packages (interrelationships of key concepts) by 
multidimensional scaling/ and 

(3) the derivation and seledtion of objective infor- 
mational sequences from the multidimensional scaling 
solutions through the use of ordering algorithms. 

Seledtion and Conversion of Ins tructlOial Material * 
Three sets of Air Force instructional material were 
selected after extensive examination of a variety of 
instructional packages related to the training of Precision 
Measuring Equipment Specialists and of technigians In 
Maintenance Electronics . The criteria used were aiSv 
follows: 

(1) Pach instructional set should consist of 
approximately fifty minutes of coherent material . 

(2) The material should be representable in both 
a pictorial and verbal format. ^ 

(3) The material should be ameniable to multidimen- 
sional scaling. In particular, the instjructional material 
should be composed of ten to twenty interrelated key 
concepts. 

The three sets of material chosen for inclusibh in 
the pilot studies on the basis of these criteria are: 

(1) The Characteristics of Master (pages 1-22 of 
the document labeled Precision Measuring Equipment ^ 
Specialist, DC cir uit Analysevi Blocks II} , 

(2) Oscilloscope Operations {pages 1-18 of the 
Maintance Electronics document entitled Oscilloscope , 
Operation) , 

(3) S eirii conduc to Theory (pages 7-24 of the 
Maintenance Electronics document entitled Semiconductor 
Theory and Solid-State Diodes) . 

The original material in the three chosen packages 
is primarily verbal. To investigate the effects of 
pictorial as well as of verbal presentation/ alternate 



forms were created by converting these primarily verbal 
packages into primarily pictorial representations. 
Approximately seventeen key concepts were derived from 
each of the packages, and a concept by concept matching 
of the information was maintained between verbal and 
pictorial modes. 

These stimulus packages were prepared in booklet 
form containing approximately one concept per page for 
presentation to subjects. Pilot Study 2 provided evidence 
that the Characteristics of Matter package was 
learned most effectively. Of the two more difficult 
packages, the Semi Conducts Theory packagre posed special 
problems for administration and interpretation of effects 
because it required some pretraining for students to be 
able to handle the concepts presented. Accordingly # 
this package was not included in the main study. The 
Characteristics of Matter package and the Oscilloscope 
Operation package were retained to represent two 16veTs 
of instructional difficulty. Of the three stimulus 
packages used in testing, one sample package/ Charac- 
teristics of Matter , is presented in both fortns, verbal 
and pictorial, in Annex A. 

Obtaining Descriptions of the Information Structures . 
The two retained packages were stu4ied separately by six 
individuals .with some prior expertise in the respective 
content areas. Both physics and psychology graduate 
students were employed. For each package the experts 
were asked to provide relatedness judgments between 
all possible pairs of key concepts. Similarity or 
relatedness judgments were submitted to the INSCAL 
multidimensional scaling program; this technique was 
described briefly in Chapter 1. A sample of (Charac- 
teristics of Mattery the instructions and stimulus 
materials for these tasks are presented in Aiinex C. 



Two dimensional solutions were judged most appro- 
priate for each package, a sample of these solutions 
are presented graphically in Figure 1 . The distance 
between each concept reflects the experts* judgments 
as to how strongly the concepts should be related 
during instruction - the rieairer two concepts are, 
graphically, the more strongly they are judged to be 
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related. The INSCAL program also produces for each 
jud^e a set of numcirlcai weights indicating the exte^^^ 
to which that judga used each of the dimension^ in his 
judgments. A sample of ^Jiese Weights is also presented 
graphically in Figure 2. The tightness of the, clusters 
of expert^ in the judges' spaces indicates their agi^ee^ 
raent on the relatedness of the concepts. 

DeVelopHttent of Triforrrtation Sec^Uerices . The multi- 
dimensional scaling solutions provide an explicit 
description of the information structures. To use 
these descriptions in developing stimulus se<^uences, 
Dr. S0lby Evans has produced a nvumber of computer based 
algorithms. These algorithms take as input the v, . 
coordinates of the key concepts in a space derived by 
the INSCAL program and produce stimulus orders of key 
concepts based on various criteria of spatial proximity. 
Details on the algorithms used and the sequences 
produced for Pilot Study No. 3 are presented in Annex 

B' ■' , • ; * ^ 

Dependent Meafevures . 

Five dependent measures have been developed for 
use in the main study. These measures will be discussed 
set)arately below. 

Similarity Judgments . This is a new measure of 
performance which requires the student to make related-^ 
ness judgments between all possible pairs of key concepts. 
Judgments are entered into the INSCAL program and the , 
ifesulting spaces compared to the spaces produced by the 
experts and spaces produced by other students. Distance 
measures and correlations between spaces provide quanti- 
tative indices of correspondence in such comparisons. . 

The INSCAL measure, obtained after training, provides 
an indication of how well a particular student jias 
understood the relationships among concepts. This, 
technique has some obvious advantages over tests of 
isolated facts in measuring comprehension. In fact, 
the similarity judgment technique may prove to be an 
objectively Scorable alternative to essay tests. A 
sample of the similarity judgment instructions /and 
stimulus materials (Characteristics of Matte^) is 
presented In Annex C. 
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Verbal Multiple Choice Tests> This measure consists 
of the set of questions developed bythe Air Force to 
assess understanding of the instructional materials* A 
sample of these questions are presented in Annex D. 

Piotorial Multiple Choice Tests > This measure 
consists of direct pictorial analpgs of the verbal questions 
developed by the Air Force (verbal multiple choice tests) . 
A sample of these questions are presented in Annex D. 

Standard Cloze Technique # This technique was devel>- 
oped hy Taylor (1953) to measure' reading comprehension • 
Every nth word in the original text is replaced by a 
blank Tn the text phrase which the student is required 
to fill. The student's comprehension score is the sum 
of the blanks correctly filled by the student* For the 
present experimentation every fifteenth word in' the Air 
Force instructional material was replaced by a blank* 
An example of these tests is presented in Annex E* 

Concep t Cloze Technique . A modified version of the 
Cloze, developed by Dr. Selby Evans, was also employed. 
Wi^ this technique the occurrence of each key concept 
in the reading phrase is replaced by a letter in the 
test phrase. The same letter is used for every occurrence 
of a particular concept. The student is required to 
indicate to which concept each letter is related. An 
example of these tests is presented in Annex E. 

Descriptions of the Complet ed Pilot Work . 

1 A series of three pilot studies designed to provide 
information necessary for the successful execution of 
the major , Phase II experiment was conducted* Each of 
these studies is discussed separately below* 

Pilot Study 1^. This study was designed to assess 
the effects of presentation rate (35 seconds per booklet 
page versus 45 seconds per booklet page) and mode (verbal 
versus pictorial) oh five dependent measures of performance 
on the Oscilloscop e Operation stimulus package* 

The main purposes of this study were: 



(1) To arrive at a stimulus presentation rate 



leading to mid-range performance, avoiding "ceiling" 
and "floor" effeobsi with both verbal and pictorial 
stimuli. Mid-range performance should provide sufficient 
statistical power to detect subtle differences in perfor- 
mance in the main r Phase II study. 

(2). To determine the appropriateness of the dependent 
measures in assessing performance with both the pictorial 
and verbal modes. 

Method . Twenty-four male and female undergraduate 
students were recruited from svunmer classes at T^xas 
Christian University to serve as subjects (Ss) in this 
experiment # The experimental sessions lasted approximately 
2 hours with the Ss being paid at a rate of $2.00/hr. 
The Ss were r2uidomly assigned to one of four treatment 
groups (6 Ss per group) as they arrived for the experiment* 

Depending on their group asslgnmeni:, Ss received 
either a verbal (original Air Force version) oir pictorial 
version of the Oscilloscoj pe Operation package in the 
original Air Force sequence ^ The ps6illoscot>6 Ope ration 
package was ch'osen for this first s tudy because 1 1 varied 
between the other two packages in difficulty and because 
it was most amenable to pictorial presentation. The Ss^ 
progress through the stimulus booklets was paced by the 
experimenter at a rate of 35 seconds per page t>r 45 
seconds per page. These two rates were chosen on the 
basis of informal a priori experimentation with psychology 
graduate students at Texas Christian University. > 

Following the completion of the instructional 
sessions, Ss were. required to respond, at their own rate/ 
to each of the dependent measures discussed earlier. 
The order of presentation of these measures was as 
follows: Similarity Judgments, Multiple Choice Tests, 
and Cloze Tests. Test order was chosen in consideration 
of the fact that the test instruments themselves contained 
content information which could have the effect of giving 
the student additional review. Hence, the tests were 
ordered so as to provide thet least amount of content 
information. Within the Multiple Choice category, half 
of the Ss received the pictorial Multiple Choice test 
first while the other half received the Verbal Multiple 
Choice test first. The same manipulation was made within 
the Cloze test category. 
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Results* Two way ' fixed effects analyses of 
::vatiance '<pif0seritation time by mode) wg^^®. P®^^°fJ^^,°5 
6ach of the four dependent measures, For the Standard 
Ciozd test / the wain effect of presentation i^ate^was^ 
slgnifioant (P « 4.43, df = 1/ 20, p < .05) , while the 
' miitt effect of presentation mode and the interaction 
were hot statistlo'illy significant, Por^the Concept < 
Cloze test, the main effect of presentation ??^te was _^ 
also significant (F « .8.61, df * 1, 20, P,^ ' "^^^J 
again, both the main effect of modd and the interaqtion^ 
were not. Inspection of the statistic^il means indicated 
that the 45 second/page rate of presentation led to 
better performance than the 35 second/page presentation 
'.-■rate. 

The similarity judgments produced by eaich subject 
were correlated with the average similarity judgments 
produced by the "experts" on the Oscilloscope concepts. 
The crude average correlation between subjepts and . 
^•experts'* in each cell of the design are presented in 
Talbe 1 (the higher the correlation coefficient, pre-^ 
sumably the greater the amciunt of information acquired 
during training) .As with the cloze measures, the 
results presented in Table 1 indicate a substantial 
difference due to rate of presentatibn and an unconsequen- 
tial difference due to mode of presentation. This was^ 
considered to be sufficient evidence for the sensitivity 
f of the similarity judgment measure to justify its - 
Inclusion in the remaining pilot studies and the main. 
Phase II experiment. 

TsQjle I , V; 

Crude Average Correlations between Experts and Subjects 
in Pilot Study I (Similarity Judgments) 

PRESENTATION RATE 



PRESENTATION Pictorial 
MODE 

Verbal 



Average 
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35 sees 
per page 


45 sees 
per page 


Average .. 


.14 


. ,, .44 


.29 


.26 


.42 ' 


■ .34. ■ ■ •• 


.20 


.43 
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Analysis of the two multiple choice tests indicated that 
none of the wain effects or interactions reached signifi-t. 
cance at the 0.05 level. 

Discussion . The mean perfortnemce on all four 
measures with a 45 second/page presentation rate ranged 
approximately from 50 to 70 percent cotreot (and approxi- 
mately 30 to 70 percent for the 35 second/page rate) * 
The level of perfotmahce associated with the 45 second/ 
page rate was considered to ade<juately avoid "ceii ling ■* 
and "floor" effects, in addition, since thje re were no 
significant interactions between mode and presentation 
rate, the same rate should^ffectively serve for both 
modes, thus the 45 second/page rate was chosen for the 
remaining studies. 

The lack of signif i<?ance of the main effects of 
presentation mode (verbal versus pictorial) may be due 
to a number of faotors, The small sample siae and the 
lack of control for individual differences in mode 
preference are probably the two most important. Both , 
of these shortcoming's will be ei^wAndted in the major ^ ^ 
study./'. ■■ " \ ^ ^ ■ V ■-■rr\',-::y/'v^ 

The significant effect of presentation rate revealed 
by th^ Standard Cloze and Concept Cloze tests indicated 
that at least these tests are sufficiently powerful to 
detect differences in performance in this type of task. 
This power should provide a basis for a valid assessment 
of the vari2d>les in the major experiment. 

The lack of significant results with the rnultiple 
choice tests may again be due to a small sa?t4>le si^e* 
These tests will be examined further in the remaining 
pilot work. 

A persistent complaint among the Ss in thii^ experi-' 
ment was the inordinate amount of time devoted to the 
testing of their learning. They felt learned material 
was being forgotten over the testing, and that fatigue 
was influencing their scores. To partially alleviate 
this problem, it was decided to drop one of the tests 
for the remaining work. To provide a basis for elimina- 
tion, correlations between the two Cloze tests (r « .76) 
and the two multiple choice tests (r « .53) were calculated. 
The higher correlation for the Cloze tests and their 
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ptoven power in<Jicated that one of them should be dropped* 
Because the Standard Cloze appeared to be less powerful 
(as indicated by a substauitially smaller F-ratio. f or 
presentation rate) and more time consuming/ it was 
dropped from the remainder of the pilot studies. 

Pilot Study 2. This study was designed to assess 
the relative dirfrculty of the verbal versions of the 
three selected stimulus packages ( Oscilloscope Operation # 
Characterisi:ics of Matter, and Semiconductor Theory ) * 
utilizing four dependent meaisures (the Standard Cloze 
test was dropped on the basis of the results of Pilot 
Study No. 1). 

The main purpose of this study, was to provide a 
basis for selecting two stimulus packages of unequal 
difficulty for use in the major experiment where inter- 
actions of instructional difficulty with stimulus 
sequence and mode of presentation will be examined. 
Because there were no significant differences between 
modes of presentation in the first studyi it was ^ 
deemed unnecessary to include both modes in this 
experiment. 

Method . Fifteen males between the ages of 17 and 
20 were obtained from Texas Employment Commission to 
serve as subjects in this experiment. The experimental 
sessions lasted approximately 2 hours with the Ss being 
paid at a rate of $2.00 per hour. The Ss were randomly ' 
assigned to one of thr^e treatment groups (SSs per group) 
as they arrived for the experiment. 

. Depending on their group assignment # Ss received a 
verbal version of either^ the Oscilloscope Operation 
package, the Char acte rls t ics of Mattey package > or the 
Semiconductor package in their original Air Force sequence? 
since the comprehension of the Semiconductor material 
was contingent on the knowle^?® some of the concepts 
of the Characteristics of Matter package/ Ss in the 
Semiconductor group were given a short pre-training 
session prior to actual training. The SsV progress 
through the stimulus booklets during training was paced 
by the experimenter at a rate of 45 seconds per page. 
This presentation rate was derived from the results 
of Pilot Study No. 1. 



Following the completion of the instructional 
sessions/ Ss were required to respond/ at their own rate 
to each of the dependent n\ea:sures except the bialtted 
Standard Cloze test. . The order of presenta'tion of these 
measures was situilar to that used in E|ilot Study 1: 
Similarity Judgments/ Multiple Choice tests / and the 
Concept Cloze test. Again/ within the Multiple Choice 
category/ half of the Ss received the Pictorial Multiple 
Choice test first/ while the other half received the 
Verbal Multiple Choice test first. 

Results . One way, fixed-effects walypes of variance 
over stimulus packages were performed' on three dependent 
measures. With the Concept Cloze test the effect of 
stimulus packages was significant (P « 6.6/ df « 2/12/ 
p < .05). With the Pictorial Multiple Choice test the 
effect of stimulus packages was also significant (F » 6^3/ 
df - 2/ 12/ p ^.05). However/ the effect of stimulus 
package with the Verbal Multiple Choice test was not 
significant at the 0.05 level. 

Post-hoc comparisons (Tukey's HSD test) of the means, 
associated with the two significant results were conducted. 
With the Pictorial Multiple Choice test/ the Semiconductor 
package and the Oscilloscope Operation packages led to ~ 
significantly poorer performance (p ^ .05) than was 
obtained mi the Characteristics of Matter material. There 
waS/ however/ no significant difference in performance 
between the Oscilloscope Operation package and the Semi - 
conductor package. With the Concept Cloze test/ the ^ 
Semiconductor package led to significantly (p ;05) 
poorer performance than did the Characteristics of Matter 
package/ while all other comparisons were nonsignificant. 
It was not felt that a formal analysis of the similarity 
judgments was called for at this time. Such an analysis 
is extremely time consuming/ and/ in light of the results 
of Pilot Study 1/ it was felt that sufficient evidence 
for their utility had been accumulated. This measure 
was rncluded in the present study primarily to further 
assess the effectiveness of its associated instructions 
and the consistency of the subjects' responses. Both 
instruction effectiveness and consistency appeared to be 
adequate for our purposes. 
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piscussion . The results of this study have led us 
to drop tKe^ Semiconductor Package from the major ejcperi- 
merit. This decision was based on the riecessity for 
pre- training with this package/ and on. the adequate 
results lirovided by the' Os oil los cope Operat i on and 
Chairacteristi^^c Matter packagesV At least with the 
Pictorial Multiple Choice test, these latter twc packages 
led to significantly different levels of performance 
(based on percentage correct) / with the Oscilloscope 
material resulting in poorer performance than the 
Ch aracter^istics of Matter package. These two packages 
should provide sufficient variation, in leairning difficulty 
for the purposes of the major experiment. 

Pilot Study 2» This study was designed to assess 
the effects of four information sequences (the original 
Air Porcfe order was not included) on performance with the 
verbal version of the Ch ar ac te rl s t i cs of Matter stimulus 
package. 

The purpose of this study was to provide a basis for 
the selection of two algorithmically produced stimulus 
sequences for inclusion in the major experiment along 
with the original Air Force sequence. 

Method . Twenty individuals (17 males and 3 females) 
were obtained from the Texas Employment Commission (15 Ss) 
and from a local church group (5 Ss) to serve as Ss in 
this experiment. The experimental sessions lasted 
approximately 2 hours with the Ss being paid at a rate 
of $2.00 per hour. The Ss were randomly assigned to one 
of four treatment groups (5 Ss per group) as they arrived 
for the experiment. * 

Depending on their group assignment, Ss received 
the verbal version of the Characteristics of Matter 
package in one of four sequences. The Char^acter'i sties of 
Matt er was chosen for this pilot work, because It was 
believed that the richer interrelationships between 
concepts in this package would cause performance to be 
more sensitive to sequence effects than would be the case 
with the relatively independent concepts contained in 
the Oscilloscope package. The Ss progress throughout 
the stimulus booklets was paced by 'the experimenter at a 
rate of 45 seconds per page. 



Th© f Quy seciuerices oi the caiyractwristlos o€ vtBitter i 
. package wei'e created by applying DJc. Evans ' orderln^A * : 
algorithitts (AnheK B) to th0 two diiia^ ''OKjie^fc . . = j ^ 

spaces" (derlv64 by the tNSCAL prograiij f i?^6i^ .tl^e ejtperts ' , 
similarity judgn«ritsi see Plgrures 3 suid 4.^ . 
the orders , the algorithms eiaplbyed plciced key <Jdrtb6pti5 - 
together in the stirtulus seduence^ t^ 

the "expert space** , Th<a differert^e betwee^^^ , 
orders were their starting points. One order, i)6gan> as 
did the Air Force order / with, the concept of W^ter * ' 
Another order began vith^ithe concept; .trea;ted last , by 
the Air Force/ jsendtftftbr ; while thd third began sWi^ the ^ 
basic bui Idihg block of the material / electron » Hxk^ : >: 
fourth . order was credited algoifi thniieaily by S tart iivgf > " 
with the concept of matter and sequencing cpndejsts "wh^.dh . 
were woat distant (non proxiifial) in the "expert s^tfi 

Following the instructional sesjBionS, Ss wisre ^'e^ 
to respond to the four dependent nteasures in thei sa^ 
manner as in Pilot Study 2. V 

Results . One wai^/ fixed effects analyses 6f Variance 
over stimulus sequences W6r0 performed on each of thre4 
dependent measures. There were no significant differences: 
due to sequence found with any of the three rteaSUiTiSSi - . 

Inspection of the mesms showed that although ngpi- 
signific£Lnt, the proximal sequence beginning with tfie 
concept of electron and the non-proximal sequence led to > 
consistently higher levels of performance than the other 
two proximal sequences. 

Again, an informal emalysiS of the similarity judg- 
ment measure revealed that the subjects were interpreting 
the instructions correctly and were producing consistent 
responses. 

\ Discussio n. On the basis of these results, the 

t proximal sequence beginning with the concept of electron 
I and the non-proximal sequence were. selected for inclusion 
* in the major experiment. Analogous sequences have been 
\ created for tho Oscilloscope packacye (see Annex B) . ; 



The nori-significcint differences between sequences 
;inay be due to the small sample size and the lack of control 
for individual differences; both of which will be remedied 
in the major experiments In addition >th^ types of 
measures analyzed may not have adequately assessed th$ 
components of comprehension that would be most affected 
by sequence; e.g. , abstraction of interrelationship^. 
Inclusion of similarity judgments in the majoi^ experiment ; 
may help to alleviate this problem. 

Conclusions from the Pilo t Experimentation. The 
results of the three pilot studies nave provided an adequate 
basis for making critical decisions about specific parameter 
values to be included in the major experiment* Stimulus 
presentation rate, stimulus packages varying in difficulty / 
and objectivively defined sequences have been chosen for the 
major experiment. The results of the pilot studies have 
demonstrated that the dependent measures chosen are probably 
sufficiently powerful to detect relatively small differences 
in performance* 

Observations, of the subjects during the pilot studies 
and discussions with them following their partioApation 
have led to modifications of, the task Instructions, 
enhanced/ readability of the pictorial stimuli, reduction 
of th^^^wnber of dependent measures, and improved formatting 
of stimulus material and the response booklets^ Hence, the 
pilot studies permitted efficient probes to determine parameter 
values and procedural refinement prior to conduct of major 
experimentation. Without this pilot work the Phasell^ study 
would undoubtedly suffer from inappropriately chosen parameters^ 
and a general lack of precisipn leading to inflated elrror 
variance. 

SUMMARY 

An extensive review and synthesis of the literature 
(primarily sloce 1965) related to the impact of certain 
variables upon the design and devc;iopi^ent ui effective 
insftructional ..equences has been presented.^ Critical 
ev^uation and recommendations for future research have 
bee^ made in the following major empirical *^reas : 

- ■ ' \ 



Impact of sequence wanipul4tibns on perforinance 
StxJident versus instructor determined sequences , " i ■ 
Principles of BtlmuXuis seq^ 

versus dediiotivf s^quenpiri^g, s^ 
of hJ.erarchioal m<^t^rial^^^ 
Interaction of individual difference Va^^ 
with'.sequeAcln^-':; ■■■■ .'"/'"'-■■y.: v\'-""':^'^' 
, Sequencing of supplemeht^ity instiudtional 
, Pescribincf th6 Information^^ 

^ In general, previous inVesti^t^S^s iiita^-t^ 
instructional sequencing have been inconsistent v> A pbrtip^^^ 
of this inconsistency is undoubtedly due to irnet^ 
flaws in the experimentation* ^ potential eximpl^ 6 
problem which should be of interest .to the Ait^ ,p6^ 
froitt ah analysis of th^ efforts of brimbhihg, A'^n 
studies have reported that branching sequehc^es^^')^^^ 
terminal perforinance and/or lesis tirte to; eom^)^^ 
- instiructional imit th^ fixed sequehceiSi ' v AithbUgh b^ 
Is the variable being intentidnally wa^ 

leads to fewer items bein^ jpresented in cpmparisbh tdj t^^ V > 
corresponding fixed sequence, improvement dti^ t0 b^^Ohl 
therefore f may be due to a reduced nximber of ihstructipnai ; ; 
items rather than branching per se. It is.iogicail^^^^ 
that a fixe^ sequence with the right iteftis dtopped wo^^ 
produde the same results,. In order to effectively test 
the effects of branching appropriate control groups yciuld 
have to be developed. ; 

In addition to methodibiogical difficulties i three 
other critical factors influencing the conflicting butcpmes 
of previous experiments on sequencing have been identifiedi 

(1) lack of systematic procedures for desOribihg V 
information structures and for developing instruptiohal 
sequences/ , " 

(2) lack of sensitive dependent measures for the 
assessment of sequence effects r 

(3) minimal attention to individual differences in 
information processing styles and capacity. 

In order to partially remedy these difficulties/ an 
experimental program has been outlined which addresses ' 
itself to each of the three critical factors, A 
multidimensional scaling approach (INSCAL) to the desoript-ton 
of information structures and the generation of instructional 



V iequdnces has been deveioped. Two new dependent measures, . 

. the Concept Cloze test, and the similarity o'f irelatedness 
• Judgment technique; have been otdated for ase^sflitient of 
sequence effects. Plans have been made to incorporate 

Xpwaaures of intellectual al>ility into • 4 main experiment 
Oft the impact of sequending. Pihally# the interactipn 
oAsequencing and two instructionaliy important variables 
(mdde of presentation and difficulty of content) will 
ba/assessed in a major study. 

A series of three pilot experiments designed to test 
out procedures and measures, and to set certain paraiineters, 
have been presented. These experiments have laid the 
groundwork for a major Study incorporating the factors 
discussed previously. The results of Pilot Study I have 
allowed us to select an appropriate presentation rate 
for the major study and have provided evidence as to the 
sensitivity of the dependent measures. Of particular, 
interest is the average correlations between the similarity 
or relatedness judgments made by the subjects and those 
made by a group of expertsi. These correlations ranged 
from .42 to .44 at thd 45 second presentation rate and 
varied in accord- with the other dependent pleasures over 
experimental conditions. 

Pilot Study il indicated that the three selected Air 
Force instructional packages "differed significantly in 
difficulty as defined by performance on three dependent 
measures . This results has permitted us to select packages 
of differential difficulty for the major study. 

Though Pilot Study III revealed no statistically 
significant diff'^rences due to four instructional sequences 
the differences between means were sufficient to allow: 
selection of two of the four for inclusion in the 
major study along witli the original Air Force sequences. 
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ANNEX A 



A Sample of Basic Stimulus Materials: Pictorial and Verbal Versions 

(Characteristics of Matter) 



CHARACTERISTICS OF MATTER 
VISUAL STIMULI 
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CHARACTERISTICS OP MATTER 
VERBAL STIMULI 



Mattet is roost often defined as "anything that has mass and 
occupies space" . It is relatively easy to form a mental ima^e of 
some object as it occupies space. 
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4.1, t ®^?«P*^i«>n of the Greeks, aVjqlent han had littid Intetecfe 
i^iJ!."""*"''? '"^terlals. He accepted a ^olid to briuar^^ 
a^continuous uninterirupted substance. Some of the Greeks thought ' 
that If a person began to subdivide a piece of materill such as 

ao indefinitely. It was JriSng ?hes/p22pll that 
tha idea of continuous matter was fostered. Others reaflondrfisA? 
there must be a limit to the nunW of SbdivisionrSSnne coSld ' 
make and still retain the original character iRtJos of tf« mfi-f^y:^ 
being subdivided. They held faSt to the idea that therS^^^^^^ 
basic particle upon which all substances are built.- 6oth of thesJ 
arguments were equally valid at that time, for there was n till 
means available to determine which factibn wS corrle? SJnkLS^^*^ 
not question this until the nineSenth ceStuJy.^"^ ^^^^^^^^ 

^ Xt was. not until 1805 that John Dalton piroposed his theories 
concerning the nature and behavior of matter^ He proposed thJtJii 
matter is composed of invisible, solid, indestrScttfirpa^^^^ 
Composition of Matter 

previously stated, the efforts of the Creeks to subdivide a" 

li llt ntlt'ihi ISddir^S^^r"^"^ because of their limited SSSlS^y. 
was near the middle of the seventeenth cehturv' thai: ftr)hAf-f nrZi^ 

extremely hard to process. During World War II manvTl^menfert wL* 
iJ:j«^!«if (>nan-made) . The namel of the SSniJade ^iJmJSJi^arr''* 

because in many oases they indicate their' origin by tKeir 
Sx^^ies'il'tL'LSJfcrtS^ljJe"?' and berkifi: ^^e''^'' . 
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cowpoundB. •J'^f JniicoJor? 0^^^ sub«tart6eB which have 

arei aalt, wood, and limeston©. 
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The discovery of the many substances that have become a part of 
our lives would hot have been possible .without a great deal of study 
of the elements. Since the elements are the fundamental substance 
of all matter^ the developinent of any new product must be based on a 
knowledge of these substances* The elements cannot be decomposed into 
a simpler substance; thereforei the dissimilarity between them can 
only be explained by assuming each element to consist of basic particles/ 
This basic particle is called an ATOM« While the atomd of a given 
element are similar # the atoms of different elements will have different 
characteristics. 

An atom is defined as the smallest particle of an element that 
retains all of the properties of the eleme^it. The following is Dalton*s 
conception of the atom: 

.a* All materials are composed of minute indestructibel particles 
called ^atoms. 

b» The atom is the smallest component part of an element that 
enters into a chemical reaction. 

o* All. atoms of a given element are exactly the same in weight, 
shape^ and size. 
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i>u^ «f/»m ts the smallest part of An element thftt enters intP 
6t negative. 



ANNEX B 



Constructed Stimulus Sequences j 
.Ordering Algorithms and Resulting Sequences 
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Ordering Algorithms and Selection of Sequences 



Development s 

The multidimensional scaling procedure (Inscal) 
creates a apace in which the concepts are represented 
as points. The space is ordinarily two dimensional or 
three dimensional^ though spaces of higher dime;islonality 
are possible. Such a space does not directly yield a 
specified ordering for the concepts: Ordering is a one 
dimensional representation. Thus it is necessary to have 
some procedure to take the multidimensional representa- 
tion produced by the scaling procedure and reduce it to 
a one dimensional ordering. 

Such a procedure could be judgmei)tal, based on an 
examination of the array of points plotted in space. A 
judgmental procedure i however ^ would be relatively diffi- 
cult to apply to three dimensional solutions and probably 
quite Impossible for solutions of higher dimensionality. 
Moreover, it is desirable to have an explicit process so 
that the ordering can be replicated and no tiiat alterna- 
tive ordering principles can be assessed for effective- 
ness. 

The problem calls for special data analytic techniques. 
It is somewhat like a clustering problem, but one might 
expect in the context of instructional materials to have 
a starting point for the ordering specified on some a priori 
basis. Possibly, an ending point would also be specified. 
The ordering processes must take such requirements into 
account. Accordingly, Or* Evans has written about a dozen 
programs and subroutines in APL denigned to accomplish 
ordering and to output the .resulting data in form which 
facilitates interpreting it and assessing the overall 
success of the ordering, in the present summary, these 
will be described along with examples of their output. 

figure .1 shows am example of the ordering results. 
The heading indicates that the topic was Structure o£ 
Matter , that it was a two dimensional solution (2D|) and 
that it was accomplished on July 9, 1973. The second 
line of the heading indicates that the method used was 
an algorithm labled Pathfinder with, its major parameter 
memory set to 1. Pathfinder accepts a starting conceRt 
which was, in this case/ matter . It computes a*,matri$t 
of distances between all pairs of concepts and precedes 
to construct an order by the principle of nearest neigh- 
bor. That is, starting with. Matter, it found the concept 
nearest to matter , and. placed it second in the order. 
In that way/ element was selected second. Pathfinder 




looked for the concept nearest element and placed 
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that third. The procedure continued throughout the _ 
Bet cSniepts^ measuring from the most recently 

Sfiosf^^cSSctprind, of course, considering only those 
which had not yet been chosen. 

The above description applies to the f^Jf^^i^J J^ . 
pathJlinder with memory equal 1. Memory can_ be set .to a 
Waiir inteaer value, say 2, 3, or 4. For memory equal 
2f ?1Shf indlf woSid b^ .. 
two ftobt recently chosen concepts . It would choose a 
Sew concept whicS b,as the minimum average distance to ^ . 
S« two most recently chosen concepts. For higher^ valuos 
of iwmSryrpathfindeJ would apply the same |.rinoiple, > 

usinl^he'iSdicated number of ^V^^^Jf l^gS^f^ 

1 A other words, this parameter acts somewhat like a 
iSmSry In tSat'pathfiSder utilizes the ^pejified number 
of the most recently chosen concepts to guide its selec- , 
tion of a hew concept. 

The display itself (Figure i) requires some enplana- 
tion. It is acJomplished by a^ separate P»^ogram and is ^ 
intended to provide both ^viantitative and graphic infor^^^ 
mation about the distances encountered by pathfinder in 
fSimlng the order. Each concept is fol^owed^by two 
nSerl. The number in parenthesis is "'f^iy S^t/?;^^ 
nation of the concept as it ©'i^i^^^^y ^"^tff^.i^^^ 
the data file. The other number, not in parenthesis,^ . 
Indicates the reaoaled distance encountered by pathfinder 
at^ewh StS! Thus the number 5 following glersen^ 
cites thJt the distance between ffiS^ •"^ SS| vaj. . 
SodeJate. The nA*ir I £<>UowinrpS2Hla,,^^ 
ittolec\ile was found to be very close to element. The^ 
S^tual d istances lie between 0 and 1; for pikrposes pf 
display /they were subjected to a linear transformation 
" 8u?r tSat the smallest'distances would be 1 and the largest 
would be 10. ^ 

The distances are also expressed graphically in 
this display. The amount of indentation is^propo^^^^ 
to the distance between a concept and the one above it. 
This arrangement is analogous to the^convention used^in^ 
constructing ordinary outlines; a subKeading is indented 
and nested under a major heading. 

Examination of the ordering in Figure 1, shows that 
matter appears as a major heading (The choice of indenta- 
H5H^or m^ter and the distance indicated after it are^ , 
bbth arbiHtryT ^nce it has no previous concept to jupply 
a distance! The first concept is automatically treated^ 
as a ma-jor heading and not indented). It can be seen that 



el<Brtont » moleoule t and conttaouhcl are displayed as sub-^ 
topics under matter / and tnese evidently conatitute a 
8ub()luster relaHvely separate from the next oluster/ 
which begins with atom * This larger suboluster appears 
to include most of the remaining concepts. O rbit and 
nucleus are finally added as additional major headings. 
Their inclusion at this point suggest that they did not 
lEit into either of the major clui^'ters/ and are slntply 
being tacked on because the program is required to ih^ . 
olude all points before it finishes. v 

Figure 2 displays th^ results of the same ordering 
M Figure 1, but in a different form. The heading again 
identifies the topic* dimeneionalltV/ date # method/ and , 
key parameters . To produce the dispiay In Figure 2 > the 
matrix of distancee between ?^11 pairs of polni^is id fitet 
rearranged so that the rows and columns correspond to 
the concept order shown in Figure 1. In othet words, 
row 1 and column 1 contain ■ the distanceef between matter 
and other concepts. Row 2 and column 2 contain the dis- 
tances between element and the other concepti9> 90 
forth. Since the distance toatrix is symmdtrlcal, and 
has 2eros in its diagonal/ only the lower triangular^ 
portion of the matrix is treated further. The el^nents 
in that portion are, linearly re scal^^^ so that the/smallest 
are represenced by one and the largest by ten.. The num^ , 
bars are then conver tad to symbols for output in such a 
way that the largest and most den#e symbols represent . 
the smallest numbers. ' u« 

This is a convenient method for displaying the over^f 
all effectiveness of a clustering procedure* If the 
ordering is generally good/ one might expect that who Ve 
collections of points should be relatively close t6 each 
other aa is suggested, in fact, by the display in Figure 
1. since short distances are represented by relatively 
dark areas, a cluster would appear in this tftatri>c as a 
dark triangle. Examination shows two such triangles, one 
small one at the tip corresponding to the cluster pre- 
viously identified with matter and a larger cluster in 
the middle corresponding to the wet of concepts under the 
term atom . An examinatibn of row 7 also indlcatSs that 
the concept of nucleus is relatively distant from, the 
other concepts and that no ordering based on nearest neigh- 
bor would include it. 

Figure 3 displays the distances traversed by path- 
finder in still another fashion. The concept n[umbers '-^ 
are plotted on the abscissa, and the distances the or- 
dinate. Clusters are -represented by low valjies and 
transition between clusters by high values. Here again, % 
the two clusters can be detected. . ^ . . 
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Figure 4 displays the results obtained with path- 
finder using a memory of two. In this case, there appears 
to have been a slight iinprovement in the ordering in 
that valence is introduced irwnediately after atom, rather 
than after conductor s i as in the case of Figure I, Logi- 
cally, valence seems; morr^ appropriate in its Figure 4 
location. The distances used in displaying the results 
of Pathfinder are the distances pathfinder actually used 
in making the selection, so that this case, they are the 
average distances between the given point and the two 
iirtmediately precepting points. Thus the distances in 
Figure 1 do not agree with those in Figure 4 . 

Figure 5 displays the rearranged distance matrix 
to show the clustering. The distances in this matrix 
are not averaged, but represent the same kind of distances 
as are shown in Figure 2. 

Figure 6 shows' graphic display of the distances 
traversed by pathfinder. 

Figure 7 represents an alternative clustering pro- 
cedure, designated Umbrella, because it may be thought 
of conceptually as closing an Umbrella* A starting point 
is chosen and all of the other points are ordered accord- 
ing to their distance fr^m this starting point. Concep- 
tually, the result is as 'if the starting point were the 
tip of an \imbrella, and all of the other points were lo- 
cated somewhere on the ribs. When the uiu>rella is closed, 
all of the other points are mapped into a single ordering 
along the umbrella shaft. 

In some sense, Umbrella is the antithesis of path- 
finder. Pathfinder examines nearby points and ignores 
the overall picture. Umbrella is based entirely on the 
overall picture as viewed from the starting point. 

The distances represented in the display of Umbrella 
results (that is the indentations and the first number 
after each concept) are the actual distances between the 
point and the immediately preceeding point. 

Figure 8 represents an extension of the Umbrella 
technique, here designated Umbrella Back. The algorithm 
is exactly the same in this case, but the ordering is 
done from the viewpoint of the last concept. Thus in 
this case, the algorithm was instructed to form an order- 
ing based on the distances 'of the concepts from the 
concept of conductors . Umbxella Back is ah intermediate 
stage and not intended as an ordering process in itself. 
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16, ■ FREE ELECTRON 2 ^ 

17, CONDUCTORS 1 (!!»)'■ , 
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PiouK« 9 ehQWs the ripsults. of qombining Umbrella > 
Bdok with the oJfig^rial Uiftbjeella peering. Obaefyatione 
Of the petformanorof Un^reUa and^UmbifeUa.Bapk sjogeflted 
that throtderlrig of each wight be fariy good^in the . ^ 
vicinity Of the initial concept ^an^i jHat the Ofaj^ljy . 
probably, deteriorated as the conoepte beojwne more distant 
from that 'focal point. The algorithm. In Pigx»re 9 forms 
a combined ordering of the two , taKipg advantage^Of the 
part which is most effective ih each ordering. The new 
ordering is the tesult of a weighted linear combination 
of the previous two orUerings* Figures 7 and 8, 8Uoh^that 
the first third of th6 order is formed by welghtina> the 
results of umbrella very heavily i the last third is^ formed 
by weighting the results of Umbrella Back, very heavily . 
(Figure 8) and the wid-sectlon is formed by an equal 
weighting of the two algorithms. 

• this ptocfedure makes It possible to specify both. ^n, 
entry point and an exit point and be assured that the. or-^ 
dering will satisfy this reguirement. Here again ^ the 
indentatlo>» and numbers Immediatjely after the concepts 
depict distances between pdi^ht and predecessor. 

Figure lb dibplays the distance matrix f6r con#iderr 
atlon of the clustering. . 

' Figure 11 presents another result of Pathfinder 
which/ ^i v^n tshe beading, should be self explaniitory. 

In general, the orderings produced with the struc- 
ture of matter unit Seemed to be fairly similar to each 
other except for the two rather distant concepts orbit 
and nticleue . This result suggests that the orclerlng 
may BsTstrongly determined by the structure of the space > 
Itself rather than by the particular algorithm used. 
The suggestion is of course encouraging with respect 
to the view thaij the structuret^of the space can be used 
to determine ah effective order. As to whether the or- 
ders suggested by the algorithms are reasonable, the v 
readet may judge for himself . 

Figure 12 presents Pathfinder results for the oscillo^ 
scope data. Figure 13 displays the distance matrix, in 
coritrast to the results obtained with the strucjture of 
matteV, the oscilloscope presents very little in the way 
of clUBtering. Apparently the structure of the space in 
this case Is substantially different. 
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Figures 14 and 15 display the results of Uinbrella 
on the oscilloscope data. Here again, no substantial 
clustering is seen, although a small cluster at the top 
,o£ the triangle suggests at least 'one group of concepts « 
ThesQ would power and scale illumihation control/ 
intensity control/ focus control/ and presentation con*- 
trols« As a matter of fact, these are the controls grouped 
together under the heading presentation controls (the 
power and scale illumination control was used as the 
starting point because it is used to turn the oscilloscope 
on# and there was some indication that the structure of 
the space related to the order in which the controls were 
used in normal operation.) . ^ 

Figure 16 and 17 display thS^results with the semi- 
conductor theory data. The figures in general should be 
self^^explanatory . ivo clusters are suggested/ both in 
the matrix and ini t*he ordered concepts display. The 
matrix suggests a fairly good clustering has been achieved* 

Figure 18 and 19 show the semi-conductor analyzied 
by the Umbrella method/ and Figure 20 shows the analysis 
using the Umbrella Back and Front combination. Figures 
21 through 26 show self-explanatory analyses of the semi-* 
conductor theory three dimensional solution. Here again > 
the reader m&y judge for himself about the adequacy of 
the orderings» 
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.ftMICONDUCTOR THEORY 2D 7 9 7 3 
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Final Production of Orders ^ • 

The results described in the previous section were 
obtained with preliminary Inscal spaces and were intended 
to provide a baisis for selecting a final ordering pro- 
cedure for sequences to be used in Pilot Study 3 and in 
the main study, inspection of the orders showed consider- 
able agreement among the alternative methods, with 
Pathfinder having a slight superiority in the opinion 
of our experts. The Umbrella Back and Front method, 
while also capable of producing good orders , required 
more parameters: an end point, as well as a start, and 
a set of arbitrary weights governing. the combining of 
the two orders produced by Umbrella. In view of these 
, considerations, we decided to use Pathfinder exclusively 
for producing the final orders . A value of MEM » 3 
was selected as a standard setting for this parameter. 

Pathfinder was modified to allow the use of an 
alternative ordering principle, the non-proximal rule. 
Under the non-proximal rule, Pathfinder chooses at each 
step the most distant concept instead of the nearest one. 
Otherwise the operation of Pathfinder is unchanged. The 
non^proximal rtile is, in a sense, the antithesis of the 
original Pathfinder process and was included to provide 
sequences which would contrast sharply with the results 
of fc'\e standard .Pathfinder. <- 

■•■■<•* 

In connection with Pilot Study 3 and with prepara- 
tions for the main study, new Inscal analyses were 
prepared for the Oscilloscope package and for the Charac- 
teristics of Matter package. (These analyses are clescribed 
elsewhere IH" this report. ) To provide order for Pilot 
Study 3, the two dimensional solution for the Character- 
istics of Matter package was used with Pathfinder to obtain 
four orderings. These provided systematic manipulation 
of the sequence of presentation variable. The orders 
are given in Figures 27 - 29, along with the corresponding 
distance matrix: 

1. Figure 27 t Pathfinder set to normal operation, 
starting with the concept matter (the starting concept in 
the Air Force materials. ) 

2. Figure 2Bj Pathfinder set to the non-proximal 
rule, starting with. matter . 

3. Figure 29: Pathfinder set to normal operation, 
starting with the concept conductors (the logical 
conclusion of the instructional unit) . 
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OSARACTSBISTXCS QFJiAfTSU 2D B 21 1 3 
ORDBRSD COUGSPp PATHPISDSR MEMx 3 
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■ 4^ j^lgure 30 : Pathfindej: set; to nomal operation, : 
starting with the concept eleotrori (the key concept . '. 
linking matter with conduotor ) « 

In addition to these orders, of which two will be 
retained for the main study, twa analogous orders (Figures 
31, 32) were produced for the main study from the new 
space obtained for the Oscilloscope package.. These w^re 
produced as follows i 

1. Figure 3U Pathfinder set to normal operation, - 
starting with the concept trace . Trace was chosen as 

the starting point because it seemed most comparable to 
el ectron in terms of its place and logical ^relation in - 
the Instructional unit r the sequence starting with electron 
was chosen^ as one of the sequences for the Characterrstlcs 
. of Matter unit > 

2, Figure 32: Pathfinder operating under the . 
non-proximal rule, starting with the concept presentation 
controls . Presentation controls was the starting concept 
in the original Air Force Ordering. 

... The computer printouts in Figures "2 * sheuid- 'be- * ^ ^ » » 
self-^explanitory and no comment on them seems to be 
necessary. Documentation on Pathfinder and associated 
programs will be provided in the final report. 
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CHARACTSRISTICS OP MATTER 20 8 27 73' 
ORDERSD CONCEPTS PATHFIlfDER MSMi 3 



1. 

2. 

3. 

4. 

5. ' 

6. 

?. 

e. 

9. 
10. 

11. 

12. 
13. 

m. 

.15. 
16. 
17. 



ELECTROS 1 (7) 



SHELLS 1 (11) 

ION 1 (5) 
BOUND ELECTRON '< (17.) 
EXCITED STATS 2 (10) 
FREE ELECTRON 2 (Hi) 

fl>lA?/?5 1 (16) 



CONDUCTORS 3 (m) 
VALENCE 3 (13) 

COVALBNT BONUS 2 (12) 

OflBZr 7 (9^ 

iir^jw 7 (»♦) 

MOLECULE 4 (6) 



ELEMENT 2 (2) 
COMPOUND' 1 (3) 



MATTER U (1) 
NUCLEUS 10 (8) 



CHARACTERISTICS OF MATTER 2D 8 27 7 3 

DISTANCES REARRANGED TO SUGGESTED ORDER PATHFINDER MEM\ 3 

1 1234567890123HS67 

2 • 
3 

»♦ 

6 oee^^ 

7 oee^^« 

8 ixoeo^^ 

9 ed^eedee 

0 oottoodoe* 

1 {^oex \\\\ 

2 X X X i s i > <* U I 

3 j!;s***»jx<»« 

5 J : { J n . 

8 xd^e 

7 i:t«o...o,jO}«,« 



FIGURE 30 



ERIC 



B-?9 



OSCILLOSGOPB 2D 8 27 73 
ORDERED CONCEPTS PATHFINDER MEM I 3 

TRACE 1(7) 

FOCffS CONTROL 6(5) 
PRBSSNTATtON CONTROLS 5 (1) 
INTENSITY CONTROL 3 (6) 
POVER AND SCALE 3 (U) 
MODE CONTROL 10 (8) 

POLARITY CONTROL 5 (10) 

VERTICAL CONTROLS 3 (2) ' 
TRIOOER SELECTOR CONTROL 10 (12) 

70IiT5 V>ii?J>iflLff VOLTS DIV 2 <9) 

POSITION CONTROL 6(11) 

TRIGGER MODE LEVEL AND STABILITY 2 (13) 
HORIZONTAL POSITION CONTROL 2 (16) 
HORIZONTAL DISPLAY CONTROL 2 (m) 
TIWJ? Z?IK ^'/Iff/yifliiff ZJj;' 5 (15) 

HORIZONTAL CONTROLS 10 (3) 
AMPLITUDE CALIBRATOR 8 (17) 



OSCILLOSCOPE 2D B 21 

DISTANCES REARRANGED TO SUGGESTED ORDER PATHFINDER MEMx 3 



1 


12315678901234567 


2 


e 


3 








5, 




6 


0 ! I lO 


7 


t • : ; )^ 


8 


. , 00 1 e« 


9 


<><>.;:: eoo 


0 




1 




2 


; : ; ; : \ : :e$* 




:•;:»;!: 


1* 


; 0 t e e • • oOd^aS 


5 


I ; 1 1 : I : :ee««^^ 


6 


0 . 1 , . , . . ; lOdddo 


7 


1 ; i : e« . . i joeoedd 



1. 

2« 
3. 

S. 

6. 

7. 

8. 

9. 
10. 
11. 
12. 
13. 

m, 

15. 
16. 
17. 
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FIGURE 31 
B-30 



voiAR^m^oMfmt^ 10 (10) 

ir^Mt?^ % (7),:, 

8 (.9) 



3 (12) 
(15) 



: ■SM^SitfXplf COMOL % 1 1 1 )' : 



1 (13) 



|pi|;^i^3H^e7:|$[|>i^^ 



".- ^.' .it^r*' 



:4.^^,.I'^nM«tA^: .:• 
■'^^vO^^ -f^^tr^)l•«^0»•■;'::,.■ 
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ANNEX C 



A Sample of "Subject" Information Structures: 
Instructions and Test Materials (Characteristics of Matter) 



INSTRUCTIONS t REtATEDNESS JU^)GMENTS 



r 



— ' — — — ^ ' ■ ■ - Score 



If you were going to tell someone abo^t wHat you 
have just learned, you would perhaps choose some key 
concepts from . the material and describe how they were 
related to one another . In order to communicate this • 
vejfy well you would have to know which key concepts 
were strongly rel^it^d and which were n 

We are interested in testing how wfell you would 
be able to describe this material to s6me6h6'^lse. in 
order to find this out we would like to S96 how well you 
can judge the strength or degiree of relationship . . 
between pairs of key concepts oh a scsale from 1 -IP. 0. 
If you feel a particular pair of concepts should be 
strongly related in describing the material to another 
person you should place a high number (Olbse tio 100) 
in the blank next to the pair, if the ctfnc^pts^are 
moderately related! then a number close to 50 should 
be appropriate a^%^pir answer. 

In order to familiarize you with the set of concepts 
we would like you to study the attached list for approxi- 
mately two minutes. To aid in your judgments, it is 
sometimes useful to mentally select the two concepts or 
terms you feel are most related aKd assign a rating ^ of • 
100 to that pair. Then, select the two, concepts which 
are least related and assign a rating of 1 to that pair. 
This setting of extremes will help make your judgments 
more accurate and consistent. 

You are now ready to begin making your judgments 
on a scale from 1 to 100. Remember, assign a, high 
number to concepts that should be highly related in 
describing this to another person and a low nvimber to 
concepts that should be treated primarily separately, 
and numbers in between to reflect different degrees 
of relatedness. , • • 



CHAHACTERISTT.es OF HATTBR 

I. MATTER 

3 4 COHPOUtin 

4. ATOM 

5 . ion 

6. HOLE COLE 

7. ELECTRON 

8. NUCLEUS 

9. owazr 

10. EXCITED STATE 

II. SHELLS 

12. I/?;/r<? AtfD COV ALEUT BONDS i 

13. VALENCE 

lU. CONDOcTORS, SEMI-CONDUCTORS, AND INSULATORS 

15. /^ifffF ELECTRON 

18. B>1WZ?5 (V'^ILEWCE, CONDUCTION: AND FORBIDDEN) 

17. flOy//D ELECTRON 



PRINTOUT', ENTER 1 0^? OfffPff STylffT ITKW 

n: 



ANNEX D 

A Sample of the Pictorial (Visual) and Verbal Multiple Choice 
Tests t Instructions and Material (Ch^iracterlstios 

of Matter) 
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INSTRUCTIONS 
VISUAL multiple' CHOICE 



— Score 



This is a test to determine how well you learned the 
study material. The pictures on each page represent a 
question. Study the pictures and circle the best answer 
to the question. Answer all questions. If you do not 
know the answer - guess. 
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CHARACTERISTICS OF MATTER 




Shared electrons 



a. free electron 

b. Ionic bond 

c. excited state 

d. covalent bond 



2. 




a. has mass and occupies space 

b. is an element 

c. is the smallest particle of an element 

d. is an atom that has acquired a positive charge 




Valence -1 



a. gain one electron in a chemical reaction 

b. lose one electron in a chemical reaction 

c. not combine with other elements 

d. combine only with inert elements 
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4. 




electron exchange 



a. free electron 

b. Ionic bond 
Cf>; excited state 
^. 'covalent bond 



5. 




Valence 
Band 




Forbidden 

Band 



Conduction 
Band 



A electrons are bound to the parent atom 

t llwtl^ns are free to conduct an electric current 

c. electrons are not permitted 

d. electrons become ionized 



6. 




a combination of two or more atoms 



a. nucleus 

b. ion 

c. molecule 

d. element 



7, X SincoNe 



a. conductors 

b. semiconductors, 
^ c. insulators 

E rJc ^ • ^ '^^^^ ®^ ements P ^ ^ 



8. 




Valence Forbidden Conduction 
B^"^ Band Band 



a. electrons are bound to the parent atom 

b. electrons are free to conduct an electric current 

c. electrons are not permitted 

d. electrons become Ionized 



9. 




Valence +1 



a. gain one electron Irt a chemical reaction 

b. lose one electron in a chemical reaction 

c. not combine with other atoms 

d. combine only with inert elements 



10. 




V. 



Hydrogen 
0>vgen 



smallest part of a' compound 



a. mixture 

b. atom 

c. element 

d. molecules 



« 



11. 



a. 
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a. free electron 

b. ionic bond 

c. excited state 
d« covalent bond 
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a.v valence electron 
' b. bound electron 
C, planetary electron 
d. free electron • 




Valence Forbidden Conduction 
Band Band Band 



a. valence electrons 

b. bound electrons 

c. planetary electrons , 

d. free electrons 



14. 



15. 



EBJC 




atom 



the stflallest particle of matter 

a chemical combination of two or more elements 

a combination of tvw or more molecules - 

the result of mechanically combining two or more elements 



n cannnot, be decomposed into simpler substances 



a. compound 

b. atom 

c. element 

d. molecule 

D-6 



a. heat energy 

b. collision with a photon 

c. electrical pressure 

d. all of the above 




a. protons 

b. electrons 

c. free electrons 

d. ions 



/Rubber ^ ^ 

a. conductors 

b. semiconductors 

c. insulators 

d. inert elements 




Extra electron 



a. combination of two or more atoms 

b. free electrons 
c« nucleus 





Valence Forbidden Conduction 
Band Band Band 



a. electrons are bound to the parent atom 

b. electrons are free to conduct an electric current 

c. electrons are not perihitted 

d. electrons become Ionized 




shell name? 



a. near 

b. A 

c. K 

d. short 




a. conductors 

b. semiconductors 

c. Insulators 

d. Inert elements 




a. protons 

b. electrons 

c\ free electrons 

d. Ions D-8 



INSTRUCTIONS 
VERBAL MULTIPLE CHOICE 



Name ' / ' • ; ■ - ' ■ Croup 

Score"" 



This is a test to deberinine how well you learhed 
the study materials Read the question and circle the 
best answer to the question. Answer all questions • If 
you do not know the ansvrer — guess • 
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Characteristics of Matter 



It Silicon emd germanium are examples of; 

A. conductors 

B. semiconductors 

C. insulators 

D. inert elements 

2. An atom with a valence of -1 will normally: 

A. gain one electron in a chemical. reaction 

B. lose one electron in a chemical reaction 

C. not combine with other elements 
combine only with inert elements 

^3. An atom that has acquired an electrical charge is a/an: 

A. combination of two or more atoms 

B. free electron 

C. nucleus 
Q* ion 

A. Glass, rubber, and sulpher are examples of: 

A. conductors 

B. semiconductors 

C. insulators 
inert elements 

5. Matter: 

A. has mass and occupies space 
is an element 

C. is the <9mallest particle of an element 

D. is an atpm that has acquired a positive, charge 

6. iThen atoms share valence electrons they are held together 
by a/an: 

A. free electron 

B. ionic bond 

C. excited state 
D# covalent bond 
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?• The smallest part of a compound is known as a/an: 

A, mixture 

B* atom * 

C. element 
D# molecule 

8» Tirtr goldr and silver are examples ofi 

A. conductors 

B» semiconductors 
Ct insulators 

D. inert elements 

9# The shell closest to the nucleus is called the shell 

A* near 
A 

C. K 

D# Short 

10 .An atom is: 

A* The smallest particle of matter 

B. a chemical combination of two or more elements 
C» a combination of two or ipore molecules 

D* The result of mechanirally combining two 
o); more elements 

11* Electrons residing in the lower energy band of the valence 
beind are known as; 

A. Valence electrons 

B. bound electrons 

C. Planetary electrons 

D. free electrons 

12. An atom may jump an orbit dvie to : 

A. heat energy 

B. collision with a photon 

C. electrical presure 

D. all of the above 

13. When the atoms exchange electrons they are held together 
by a/an: 

A, free electron 

B, ionic bond 

C, excited state 
D» eovalent bond 
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14. 



In the conduction bands 



A. electrons are bound to the parent atom 

B. electrons are free to conduct electric 
current 

C. electrons are not permitted 

D. electrons become ionized 

15. The particles orbiting the nucleus of an atom are called i 

A. protons 

B. electrons 

C. free electrons 

D. ions 

16. Electrons removed from the influence of the parent atom 
are known as: 

A. valence electrons 

B. bound electrons 

C. planetary electrons 

D. > free electrons 

17. A combination of two or more atoms is a/an: 



A. ^ nucleus 

B. ion 

C. molecule 

D. element 



18. An atom with a valence of +1 will normally : 

A. gain one electron in a chemical reaction 

B. lose one electron in a chemical reaction 

C. not combine with other atoms 

D. combine only with inert elements 

19. In the lower energy level band of the valence band of 
an atom: 

A. electrons are bound to the piarent atom 

B. electrons are free Co conduct electric, 
current 

C. electrons are not permitted 

D. electrons become ionized 



20. A substance that cannot be decomposed into simpler 
substances is a/an: 

A. compound s 

B. atom 

C. element 
molecule 

D-12 




21. The nucleus of an atom contains: 



A« protons 

B. electrons 

C. free electrons 

D. ions 

22. In the forbidden band: 

A* electrons are bound to the parent atom 

electrons are free to conduct electric current 

C. electrons are not permitted ;^ 
electrons become ionized 

23* An atom which has jumped orbits is said to be: 

A. a free elet^tron 

B. in an ionic bond 

C. in an excited state 

D. in a covalent bond . ^ 
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ANNEX E 



An Example (Characteristics of Matter) of the 
Standard Cloze and Concept Cloze Techniques t 
Instructions and Test Material 



CHARACTERISTICS OF MATTER 



Name : ^Group, 

Score 



This test consists of the same text material pre- 
sented previously. A number 6f words have been taken 
out of each passage and in place of each word you will 
find «i space containing a letter. The words omitted 
were concepts considered important to the understanding 
of the characteristics of matter. The letters which now 
appear in the text correspond to one of the concepts 
listed below. Your task is to find out which letter 
goes with each concept. When you know the answer, fill 
in the letter beside the concept. There is only one 
letter for each concept. Fill in all the spaces beside 
teh concepts. 

CONCEPT 



Matter 


Conductors 




Element 


Semiconductors 




Compound 


Insulators 




Atom 


Free Electron 




Ion 


Valence Band or 


Valence Shell 


Molecule 
Electron 


Conduction Band 
Shell 

Forbidden Band 


or Conduction 


Nucleus 


Bound Electron 




Orbit 






Excited State 






Shells 






Ionic Bonds 







Covalent Bonds 

Valence or Electrovalence 



CHARACTERISTICS OF MATTER 
CONCEPT CLOZE 



G ia most of ton defined as "anything that has mass 
and ott |||{<flflff ace" . it Is relatively easy to form a mental 
imaga or UQMq object as it occupies space. 

With exception of the Greeks, ancient man had little 
interest in the structure of materials. ' He accepted a solid 
to be just that - a continuous uninterrupted substance. Some 
of the Greeks thought that if a person began to subdivide a 
piece of material such as copper, he could do so indefinitely. 
It was amon. these people that the idea of continuous ^ 
was fostered. Others reasoned that there must be a limit J:o 
the number of subdivisions that one could make and still retain 
the original characteristics of the material being subdivided. 
They held fast to the idea that there must be a basic part- 
icle upon which all substances are built. Both of these argu- 
ments were equally valid at that time, for there was still no 
means available to determine whch faction was correct. Mankind 
did not question this until the nineteenth century. 

It was not until 1805 that John Dalton proposed his theories 

concerning the nature and behavior of C He proposed 

that all . c , is composed of invisible, solid, indes- 
tructible particles. 

Composition of C 



As previously stated, the efforts of the Greeks to sub- 
divide a simple material were unsuccessful because of their 
limited technology. It was near the middle of the seventeenth 
century that Robert Boyle phrases the first definition of an 

"elemental substance." He stated that an ___S is a substance 

that cannot be decomposed into similar substances. There are, 
at the time of this writing, one hundred two known S with 
the possibility of discovery of many more. They range from 
abundant S such as silicon, carbon and oxygen to rare S 
such as lanthanum, samarium and tuletium which are extremely 
hard to process. During World War II many S were synthe- 
sized <man-made) . The names of the man-made S are interes- 
ting because in memy cases they indicate their origin by their 
names. S such as americium, californium amd berkll^ are 
excunples of S of this -type. 

Although many substances are composed of a single S , 
a far greater number of substances are composed of a combination 

of different S_ . When two or more S are chemically 

combined, they form 0 . A common example of a 0 would 
_9^a substance such as water, which is composed of the 



6 ^hydrogen and the S o xygen. 



As S such as hydrogen and oxygen are chemically 

cottbined to form a , they lose the/ir individual 

identity. A most vivia realization of this fact can be noted 

when visualizing white crystaline suger« This O ^consists 

of the blacky solid g c arbon ^ and tv/o colorless gaseous 

S , oxygen and hydrogen* Thousands of O a re 
Known, each of which possesses definite chemical and physical 
properties that enable it to be distinguishable form other 

O . The almost limitless conbinatlons of S t o 
form ^ h as led to the discovery of the many substances 
which have become a part of our daily lives • A few common 
examples of 0 are: salt^ wood, and limestone. 

The discovery of the m^y substances that have become a 
part of our lives would not have been possible without; a great 
deal of study of the S » Since the s are the 
fundamental substance of all C ; , the development of 
any new product must be based on a knowledge of these substances 
The ^. cannot be decomposed into a simpler substance; 
therefore, the dissimilarity between them can only be explained 
by assuming each S ; to consist of basic particles. This 
basic particle is called an F While the F 
of a given S are similar, the F o f different 
S will have different characteristics 



A n F is defined as the smallest peirticle pf an 
8 that retains all of the properties of the S 
The following is Dalton's conception of the F < 

a« All materials are composed of minute indesftructibel 
particles called F ♦ 

b* The F i s the smallest component part of an 

£f \ t hat enters into a chemical reaction. 

c# All P of a given 3 are exactly the same 

in weight, shape and size. 

F is the smallest part of an g that 
enters into a chemical change, b\it it does so in tne form. of a 
charged particle* These charged particles are calle d t , 
and they are of two types — POSITIVE and NEGATIVE. A positive 

yjr m ay be defined as an ^tha^js^has become 

positively charged. A negative J m ay defined as 

an F t hat has become negatively charged. One of the 

properties of charged j is that iL^liPf the same 

charge tend to repel one another ^ whereas *T ^ o f unlike 
charge will attract one another. The term charge has been used 
loosely. At present, charge will be taken to mean a quantity 
of electricity which can be one of two kinds* positive or neg- 
ative . 

O The combination of tv70 or more F to form the smallest 
ERJ^C t of a 0 ^^comprises a structure known as a 
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For example I v;hen the o ^ water is formed, two F 

of hydrogen and one . f ot oxygen combine to fom a 

K o f water> . A single k is very email and is 

not visible to the na!:ed 6ye. Therefore , a fev; drops of 

water may contain as manyWs a million k ^» A single 

^ is the smallest/particle into which the q can 

be broken down and still be the same substance, once the last 

K o f a 0 is divided into , F , the substance 

ho longer exists . 

Once the basic parts of the F are known, an 

attempt can be made to construct a suitable atomic model. This 
model must accurately represent and be compatible with all of 
the facts knovm at the time the model is constructed. Dalton 

viewed the F a s a small indestructible sphere having 

the ability to become firmly attached to other atomic spheres. 
Later and more advanced experimentatidn proved that tiny charged 

particles could be removed from inside the F . As a 

result, Dalton's model could no longer be considered satisfactory. 

Thompson advanced the theory that F must have a 

structure since a fundamental particle must be extracted from 

them. He envisioned the F^^^ ^as being a sphere in which 

were contained a sufficient nun*er of positive and negative 
charges to make the overall charge of the p . ^ neutral. 
Thompson's idea that the positive and negative chi'rges were 
evenly distributed throughout a sphere was disproved in an 
experiment conducted by Sir Ernest Rutherford. 

In this experiment, a narrow beam of alpha particle^^ 
(positive double charged helium j ) was obtained from 
a sample of radium and directed through a 'small hole in lead 
block toward a thin sheet of gold foil. If the p 
were constructed as Thompson visuallzedy the positive alpha 
particles should have had their paths deflected by small amounts 
due to the positive charge distributed evenly through the 

F .The x-esults wer6 hardly what was expected. Ruther- 

ford ifound that most of the alpha particles went right through 
the gold foil without being deflected at all# The remaining 
particles received large amounts of deflection, some as high 
as 180^, This could only be explained by assuming that all of 
the positive charge in the F w as concentrated in 
one area away from the negative charge. Any alpha particle 
coming close to this center of charge would be severly de- 
fleicted, while one passing some distance away would go through 
the foil undef lected. 

From the results of Rutherford's experiments, emerged our 

present concept of the structure of the F . The F 

is, now believed to consist of a group os positive and neutral 

g articles (protons and Neutrons) .called the _E , suurounded 
y one or more negative orbital - M / This concept^ of the. F 
can be likened to our solar system in which the sun is the 
massive central body, and the planets revolve in p ^at 

Er|c ^ . 



dlsonfete distances from the sun. The M whirl about 
the nucleus of the F much as the planets whirl abou:t 
the sun. in both the solar system and the F , practically 
all the C in the system is contained within the 
central body. 

Excluding particles such as mesons and neutrinos, which 
are of little importance to electronics i the E of an 

F is made up of heavy particles called PROTONS and 
NEUTRONS. The proton is a tiny charged particle containing, 
the smallest known unit of positive electricity • The 
neutron ha^ no electrical charge. 

In the lighter S # the' E contains approxi- 
mately one neutron for each proton while in the heavier ; ' S ■ 
there is a tendency for the neutrons to outnumber the protons. 

E of the heliu W F consists of two protons 

and two neutrons. In contrast, an ' ^ ' ' F ' ^ of mercury has 
eighty protons and one hundred twenty neutrons in its E 

The mass of a proton and a neutron^is very nearly the same 
and is equal to approximately 1.67 x 10""^ gram. This mass is 
about 1845 times as great as the mass determined for the 
M 



To obtain some idea of the relative dimensions of a typical 
F , assume the ' ' . F ' ' to be expanded in size until 
its outer diameter is equal to twice the length of a football 
field. The ■ E , positioned in the center, would appear 
as a sphere having a diameter equal to that of a penny 1 This 
example vividly illustrates th^ vast emptiness which exists 
within the F One can now readily see why most of 

Rutherford *s alpha particles streamed through the thin gold 
foil with little or no deflection. 

Surrounding the positive E of a typical F 
is a cloud of negative charge made up of pl;nietary M 
Each of these M contains one unit of negative electricity 
equal in amount to the unit of positive electricity contained 
in the proton. 

In the normal F , the numbeir of M in this cloud 
is exactly equal to the nur(i)er of protons in the nucleus. The 
net charge of a normal F is therefore zero, since the 
equal and opposite effects o£ the positive and negative charges 
balance one another. 

. If an external force is applied to an F , one or 
more of the outermost M: may be removed. This is possible 
because the outer M are not attracted as strongly to the 
postive E as are tKe inner M 
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When F combine to form an elemental substance/ the 
outer M of one F will interact with the outer M of 
neighboring F to form bonds betwoon the F . These atomic 
bonds constitute the binding force which holds all C to- 
gether • When bonding occurs in some substances, each F 
retains its full complement of ; ; M ^> In other substances # 
one or more outer M will be gained or lost as a result 
of bonding. As ihdicated by the above statements/ the M 
configuration of the F is of great importance • The 
chemical and electrical properties of a material are almost 
wholly dependent upon the M arrangement within its F , 

As might be expected/ the E is well shielded by the 
M cloud and does not enter into chemical or electridal 
processes. To disrupt the E of an ' ' F requires a vast 
amount of energy such as is released by each' ' ; F' in the 
explosion of an atomic bomb. 

The total energy contained by the M ^ (kinetic plus 
potential) is the factor which determines the radius of the 

M B . In order for the M to remain in this B 
It must neither gain nor lose energy. 

Light energy exists in tiny packets or bundles of energy 
called photons. Each photon contains a definite amount of 
energy depending on the color (wavelength) of light it re- 
presents. Should a photon of sufficient energy collide with 
the orbital hydrogen M , the M will absorb the protons 
energy. The M which now has a greater than normal amount 
of energy will jump to a new B farther from the E . 
The first new B to which the M can jump has a radius 
four times as large as the radius of the original B . 

Had the M received a greater amount of energy, the 
next possible B to which it could jump would have a radius 
nine times the original. Thus, each B may be considered 
to represent one of a large number of energy levels that the 

M may attain. It must be emphasiised that the M cannot 
jump to just any B . The M ' will remain in its lowest 

B until a sufficient amount of energy is available, at 
which time the M will accept the energy and jump to one 
of a s'aries of PERMISSIBLE B . An M cannot exist 
in the spaces between permissible B or energy levels. This 
indicates that the M will not accept a photon of energy ^ 
unless it contains enough energy to elevate the M to one 
of the allowed energy levels. Heat energy and collisions 
with other particles can also cause the M to jump B . 

Once the M has been elevated to any energy level 
higher than the lowest possible energy level, the . ' F , ^ 
is said to be in an N . 
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The M will not remain in thifl excited condition for 
more than a fraction of a second before it will radiate the 
excess energy and return to a lower energy B » To illus- 
trate this principle assume that a nonnal ' M nas just re- 
ceived a photon of energy sufficient to raise it from the first 
to the third energy level. In a short period of time fchti 

M may jump back to the first level emitting a new photon 
identical to the one it received. 

A second alternative would be for the ^ M to raturn 
to the lower level in two jumps; from the third to the second, 
end then from the second to the first. In this case the 

M would emit two photons, one for each jump. Each of these 
photons would have less energy than the original photon which 
excited the M and would represent a longer wavelength 
of light. 

This principle is used in the flourescent light where 
ultraviolet light photons r which are not visible to the human 
eye, bombard a phosphor coating on the inside of a glass tube. 
The phosphor electrons in .returning to their normal B emit 
photons of light that are of a visible wavelength (longer 
wavelength) . By using the proper chemicals for the phosphor 
coating any color of light may be used in lighting up the 
screen of a television picture tubei. 

Although hydrogen has, the simplest of all F , the 
basic principles just developed apply equally well to the F 
of more complex S . The manner in which the B are es- 
tablished in an F containing more than one M is some- 
what complicated and is part of a science known as quantum 
mechanics. In an F containing two or more M , the M 
interact with each other and the exact path of any one M 
is very difficult to predict. However, each M will lie ' 
in a specific energy band and the above mentioned B will be 
considered as an average of the M positions. •••"•'^^ 

The difference between the F insofar as their chemi- 
cal activity and stability is concerned. Is dependent upon 
the number and position of the particles included within the 

F . F range from the simplelst, the hydrogen F 
containing one proton and one electron, to the very complex 
atomic structures such as silver containing forty-seven pro- 
tons and forty-seven electrons. How then are these M 
positioned within the F. ? In general, the M reside 
in groups of B called ^ P . These ;^ P are elliptically 
shaped and are assumed to be located at fixed intervals as 
predicted by the Bohr concept. Thus, the P and the number 
of M required to fill them, may be predicted. The second 
: P for example, would contain 8 M when full. In addi- 
tion to being numbered, the P are also given letter designa- 
tions. Starting with the P closest to the E and progressing 
outward, the 'P are labeled K, L, M, N, 0, P, and Q respectively. 
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The p are considered to be full or complete when they 
contain the Idllowing quantities of M « Two in the K P > 
eight in the L P » eighteen in the M , and so in accor- 
dance with the exclusion principle. Beyond the N V , the 
actual number of M regulred to fill a P has not been 
experimentally determined. 

Progressing away from the atomic E / the .first M 
P which does not have the full con^plement of . M in that 
i> is called the I . Even though the inert . B 
(helium:, neon, argon, krypton, xenon and radon) have a full 
complement of M in all P , the^ outer P of these 

S is still called the I . The stability of F 
is greatest when the ■ I of an F is occupied by the full 
quota of allowable M « Hence » the S lithium has mini- 
muro stability while neon has maximum stability. 

Eleotronioa and M theory is a very recent science 
compared to chemical science. The term R was used as a 
part of the standard chemical vocabulary long before the 

M concept was evoloved. When the m t heory was 

Hrmly established, the new term^ r w as officially adopted; 

the two terms may be used interchangeably . 

The capacity of one s to combine with ^mother 

S i s indicated by the number of m w hich an 

F "^d onates, or accepts, or shares with another p 

to secure a complete l , and is called r 

^he R o f an F i s expressed in terms of a 

number, prefixed by a + or- sign, indicating how many m 
the F gains of loses during a chemical reaction, or 
Indicating the number of- electron -pairs shiired during the change. 
Generally, if the.^ H has more th«m half of the eight 

M ^to complete its i , it will tend to complete 

Its P" b y removing M f rom the i o f 

some other F ^ d uring the process of forming a r> , 
The F gaining " m a re prefixed by a minus (-) sign. 

It is also generally true that if an F h as half of its 

I f illed/ the f m ay act in either direction; that 
is it may donate its . R . m t o one type of 

F b ut when combined with some other ^ f / it may 

remove m ^from the gther f t o fill its own i 

The R n umbers are prefixed with either a + or - 
sign depending upon the chemical reaction which takes place. If 

the S h as less then half of its required r m 

it will usually donate its M t o some other f during 

the process of forming a 6 and their _ r number is 

prefixed by a plus (+) sign. 
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Previous disoussions have shown that F p ossessing 

wore than half of their R M g enerally tend to 

fill their I a t the Expense of other F Those 

' ^ ^^^ possess half of the M r equired to 

fill the I g enerally donate their R M 
to other "^ ^ When chemical bonding is .accomplished oy 

an exchange of M b etween F the F are said to 
be held together in an D ' _ _ 

Many F r eact chemically to form a 0 -without 

donating or accepting M.. ... ; the differe nt ^F s hare the 

M t hey have in common. '^Phe sharing of R M 
between ' F is known as electron-pair or Q > ^ 

It was mentioned previously that J d o exist and that they 
are F t hat have assumed a charge. It was stated that there 
are positive euid negative J . The process whereby an F 
acquires a charge will be discussed at this time« 

It is possible to drive one or more M _o ut of any of the \ 
P s urrounding the E « in the case of incomplete P , 
it is also possible to oause one or more additional M t o 
become attached to the F In ^either case/ whether the ^ F 
loses M o r gains '^' M , it 'is said to be IONIZED ♦ For 

ionization to take place there must be a transfer of energy 
which results in a change in the Internal energy of the . F > 

ThU8# ionization is the process by which ikn F loses 
or gains ^ M « . " 

An I* . h aving more than its normal amount of M 
acquires a negative charge, and is called a NEGATIVE j . " 

The p t hat gives up some of its normal M i s left 
with less negative charges than positive charges and is called 
a POSITIVE J . 

In the study of electronics/ the association of _ C 
and electricity is of paramount importance, since every electronic 
device is constructed of parts made from ordinary C / the 
effects of electricity on C m ust be well understood. As 

a means of accomplishing this, all the S i of which C 

is made amay be placed into one of three categoriz,e [' A ' * " * 

H / and G i ^. .^ ^^ exajnplei are s such " 

as copper and silver which will conduct a flow or eied^iclty 
very readily. Due to their good conducting eUDilities they are 
formed into wire and used whenever it is desired to transfer 
electrical energl^ from one point to another. G Cnon-^conductors) 
on the .other liandr do not conduct electricity tp, any .great 
degree and therefore used when it is desirable to prevent a 
flow if electricity. S a nd O such as sulphur^ rubber, 
and glass are goo d G'^ Materials such as germanium and 
silicon are not good conductors/ but cannot be used as G 
either/ since their electrical characteristics fall between 
those o f A an d G . Thesd in-between materials which 
not make good A / or good G are classified as H ♦ 



• .4.4 P"viously mentioned that by the process of ioni- 

P ''^S^^ ^5^2 the inf luLce o? ?he pSJent 

• ^ ■ V reeved from the R , are capable 

of^ving througTthe material under the inJIuince of external 
forces. It is by virtue of the movement of these M that 
electrical energy Is transported from place to plac5r~ 

°5 ® material such as copper to conduct 
electricity must therefore depend on the SSmber of dislodaed 
IsVa«S"^^i^ available within the materiS!: SiLe co^l? 
is a good _A_, it must contain vast numbers of dislodged 'or 



to refer^Sfc^tf m'^ i« necessary 

CO reter bacjc to the M energy levels within the p t*: 

was previously stated-tKat if precisely th^eriShtLouKT-^f 

the piece of copper obtains enough energy to become-7?ee/ 

averaJ^pLce^Sf Soppercon?L^J«''2 * "^^^ 
In faSt, a piece of coLer ^? JL^T^^"*!?*^ ^^^^ 
apDrxlmat«iv^7i0p temperature (72**?) is 

aoonsiderable amount of heat LeJS? * J"""'"' contain 
enerp, .long witHtSer IwrnrS^it JaJ ?^S?!?f„°* 
electrons to the energy levels eh„e'-Ser JS^'bMSS^ |i 



elevate the 
free« ' 



materU?? Snt!"ina^2?a*^?S;^" ' i?^^^*^ wonder why all 
conduct ellS?rliii5^i5!l?r2«?r""JK°* *"**9y dj not ' 

that the mT in va??S2a L^fihi a«awer lies in the fact 

Of energrtTTeJSmelile! ^JfoSlr^'^P^^hfi 

called the i and the rt Z^Zf &r- energy bands 

18 an energTgSp^flSg-tH T-' ^^^^ energy ^ands 

consiaer^rbi^^f??„{" ];^?r^ They are 

not available for^h'f ^onduSJ? e'llcfr'lcit'yr-^-^"^ 

enough"ener^ £om^xtiH^?''f ^ must. gain 

and appear ih the__a_;. ""^^ iiump the "forbidden gap 

Once In the M , the m * ^ - 
to move along th rough the a — tS^^ ! free and may be nade 
current. ^ — ^e form of an elect^-ic 

a largr^SiHt^orenJ^J^ni?^!" ^^^^ ««ans that 

insulItihg^mSte?ia! before It ^g<3ed to each M i n an 
X- <=an become free. Th^TTat room 
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4.^»»»v..4-itv<» fltjffietent energy is not available to cause M, 

tHSJlp ?o the !!Sl has practically no 



The A has little or no forbidden gap. Since this is 

true, undSFI^Krmal conditions the U for ^ A. contains 
a sufficient number of M to makiTt a good of elec- 

tricity. 

The H' being neither a good A ' or a good , G has 

an energyTapTaetween that of a A and that of an G 
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This test consists of the toxt material used in charac- 
teristics of matter instruction. A number of words have been 
taken out of each passage ^ and in the place of each word you 
will find a space which is underlined* Your task is to fill 
in, for each blank space, the precise word which was t/Ucen 
out. In other words,, you are to try to guess exactly what, 
words appeared previously in the text and are now removed* 
Your ability to correctly fill in the blanks should reflect 
your knowledge of the topic. 



Matter is most often defined as "anything that has 
mass And occupies space". It ____ relatively easy 
to form a mental image of some object as it occupies spa6e- 

. ■ exception of. the Greeks ancient man had 
little' interest in the structure of materials. „ ■ ' ,,, 

accepted a solid to be just that,' a continuous uninterrupted ; 
substance. Some of the thought that if a per- 
son began to subdivide a piece o£ material such as : ■ ,„.,.-v>- 
he could d6 so indefinitely. It was among these people , 
that the idea of matter was foetered. Otjiers ' 

reasoned that there must be ^ limit, to the.nujaber •.■„.; V,. ' - 

subdivisions that bne could make and still retain tr\e 

original characteristics of the material divided. 

They held fast to the idea that there must be. a basic 
particle which all substances are built. Both , 

of these arguments were equ^illy valid at the ' / , , 
for there was still no means available to determine which, 
faction was correct . Mankind ■ not que&tion th^s 

until the nineteenth century. 

It WAS hdt until 1805 that Jphn ■ pr6pp$ed . x 

his thebriesi concerning the liiature and behavior of matter. 
Ho proposed that all \ . is composed of invisible, ., .-y 

V solid, ind0fi»tr!Uctible particles. . 

composition ; of M«tter; ; - • ' 'v; '''^ '^^^^^^ 

' As previously stated, the ^ ot the Greeks, ^ . 

to subdivide a simple material were unsuccessful, because 

of their limited It was near the middle <>f 

the seventeenth century that Robert fioyle phrases the 

definition of an "elemental substance." He- 
stated that an ELEMENT is a substance that • be 
decomposed into similar substances. There are, at the * 
time of this writing, one .... two known elements 
with the possibility of discovery of many more* They . 
range from elements such as silic<?n/ carbon 

and oxygen to rare elements such as lanthanum, samarium 

tuletium which are extremely hard to process. 
During World War II many elements were . (man — 

made) . The namfes of the raan.-made elements are interest- V — ^ 

ing because! in many cases they _^ their origin 

by their names. .Elements. such as amerioium, californium , 

and berklium. are examples ^ ele^Aents of this 

type * -"'^ . ^ 

.. Although many substances are composed of, a single 
element, a . greater number of substancds are 

cornposed of A combination of different elements. When 
■iMty, more Elements are chemically combined, ■. ,v;:, 

:.'t;h^y f orm ^OMPdONDS . A common examj>le of comp.ound- , ' • f 



- ft substance such as water, which is o6in- 

posed of the element hydrogen and • - .' ' element 
oxyg©n« ■ 

As elements such as hydrogen and* oxygen ate oheml- 

oaJLly cornbined to form compound, they los6 

« their individual Identity. A most vivid realization of 
this. fact can noted wheh visualiainq white 

orystaline sugarl This compound consists of the black, 
solid! element , and two colorless gasepus ele- 

. V tnents, okygdn and" hydrogen. Thousands of ccampourtds are 
known, each , which poasesses def inite Ghemlaai 

and :phy8ioal pi^operties that ehable it to be distinguish- 
able from ^ compounds. The almost lijnitless 
corrhi nations of elements to form compoiinds has led to the 
^ of the many substances which have become a 
\ part of our daily lives. A common examples 
■ of compounds are» salt, wood , and 1 imes tone . 

The discovery of the many , ^ \ . \ that kave 
become a part of our lives would not have beon possible 
without great deal of study of the elements. 

Since the elements are the (fundamental substance . 
all matter, the development of any new products musi be ' 
based on a knowledge ... these substances. The • 

elements cannot fae decomposed into a simpler substance? 
therefore, the dissimilarity them can only be 

> explained by assuming each element to consist of basic 
. particles. ■ . basic particle i^ called an ATOM. 

While the atoms of a given element are . ■ , the 

atoms of different elements will have d'ii£ere)\f charac- 
teristics. . 

'f- / ' ' ' ■ ' ' ~" ■ 

An atom is defined as ■ smallest particle 

of an eloment that retains all of the properties of the 
element, following is Dalfcoh's conception of 

^ the atom: " .^■^^^'^'■■"■■''^^ 

a. All materials are composed of minute indestructible 
V - ■ - ' called atoms. 

b. The atom is the smallest componenjt part of an 
element that enters a chemical reac- 
tion.. \ ' ..^ . 

c. All atoms of a given element are exactly the same 
I , in shape , and size i 

^ ThQ atom. is the smallest part of an element th^t enters 

a chemical change, but it <3des so in th6 form of 



a Charged particle. charged particles are called 

)B>;'-t^w:-'^^^'--'^^ they are of two types -»,-PC)SITIVE afid NEGATIVE, 
^^■^■"i^-' ^:".- ■ ' ■ positive ion' may be defined as an atom that "has 

j^^lllplcom^ positively charged. A : ; r-'.^ ' ion maV bo defined 
c^ii- > ' f ^ ^^^"^ that ha^, become negatively. bhajrgedT one' of. < / 
IfeSifllliilliii. ■ pr6^ 

^^mrmgrnmSMM^^'"^^^^ J^epo l 6n6tti6r , . "wHe^o£i^:S-i<^f flISi 



of unlike charge, will attract one another. The term 
charge has " used loosely. At present, charge 

will be taken to mean a quantity of electricity ■ ' . ' 
can be one of two kinds ^ positive or negative. 

The combination of two or . atoms to form 

the smallest part of a compound comprises a structure 
known as _ MOLECULE. For example, when the com- 
pound water is formed, two atoms of hydrogen and ^ 
atom of oxygen combine to form a molecule of waterT S ~~ 
single molecule is small and is not visible to 

the naked eye. Therefore, a few drops of may 
contain as many as a million molecules. A single molecule . 
is the smallest into which the compound can be 

broken down and still be the same substance.. ' 
the last molecule of a compound is divided into atoms , the " 
substance no longer ^ . 

Once the basic parts of the atom ate known, ah attoitpt 
can be made construct a suit<dt)le atmio model* . 

This model must accurately represent and be compatible with 
■ of the facts known at the time the model is conr 
structed. Dalton viewed the . . ■ ' . ; . . ..as .a' small ^ndestjcuo*' 
tible sphere having the ability t6 become firmly attached , 
to other . . ; . spheres. L«^ter and more advanced experl* 

mentation proved that tiny charged partiales <bould be removed 
. " , ' ^ . inside -the atom. As a jfesult, Dfilton's model - 
could ho lonc/er be opnsideted satisfactory. , 

advemced the theory that atoms must have a 
structure since a fundamental particle must 
extracted from them. He envisioned the atcm as being A 
sphere in which were a sufficient number of 

positive and negative charges to make the overall charge of 
■ ■ atom neutral. Thompson's idea that the positive 

and negative charges were evenly distributed throughout 

sphere was disproved in an experiment conduoted 
by Sir Ernest Rutherford. , 

In this experiment, narrow beam of alpha 

particles (positive double charged helium ions) ... 
obtained from a ________ of radium and directed through 

a small hole in a lead block toward a sheet of 

gold foil. If the atom were constructed as Thompson visu- 
aliited, the positive particles should have had 

their paths deflected lay small amounts duo to the positive 

. distributed evenly through the atom. The results 

were hardly what was expected. Rutherford found . 
liiost of the alpha particles went right through the .gold 
foil without being deflected all. The remaining 

particles received large amounts of ddf lection, some as 
high as 180°. could only be explained by 
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asaumlng that all of the positive charge in the - . 
was concfintrated in one area away from the negative cIYarge* 
Any alpha particle cowing ' - . ? - to tljii^vcenter of 
charge would be> Beverly deflected/ wnile on passing some 
distance ^ would go through the foil undef looted. 

From the results of Rutherford's experiments, emerged, 
our concept of the structure of the atom • The 

atom is now believed to consist ' a group of posi- 

tive and neutral particles (protons and neutrons) called 

the NUCLEUS, surrounded orie or more negative 

orlfital electrons. This concept** of the atom can be likened 
our solar system in which the sun is the massive 
central body, and the ■ revolve in orbits at dis- 

crete distances fron\ the sun • The electrons whirl about 

the of the atom much as the planets whirl abput 

the sun. In both the \ system and the atom, orac- 

tically all the matter in the system is contained within 
.. \ ^ . central body. 

Excluding particles such as mesons and neutrinos, 
which are of little importance . ■ . . ' ' ^ • electronics, the 
nucleus of an atom is made up of heavy particles called ■ 
PROTONS NEUTRONgt The J?roton Is a fclny^oharged 

paxtiole containing .the smal last known unit of • , 
eieotrioity. The neutron bad nQ;dle^trioaiI oTxarget 

In the lighter elements, the nucleus contains - ' v ■ 
one neutron for each proton while in the heavier elements 
there is a tendency the neutrons to outnumber the 

protons. The nucleus of the helium atom consists of 

protons and two neutrons. In contrast, an atom 

of mercury has eighty protons and . ; hundred twenty 

neutrons in its nucleus. 

The mass of a proton and a* neutron • ^ ^_ very ^ ■ * 
nearly the same and is equal to approximately; 1 . x 10*^24 
gram. This wass is 1845 timed as great as the 

mass determined for ^e electron. 

To obtain some of the relative dimensions . 

of a typical atom# assume the atom to be expanded ' • 

size until its outer diameter is equ^l to twicd the length 
of a football . " .. . The nucleus, positioned in the 

center, would appear as a sphere having A diameter ' / 
to that oi: a penny! -This example Vividly illustrates th<a 
vast emptiness which exists the atom. One can 

noV raadiiy see why most of Ruthorford^s alpha particles 
gtre^utved the thin gold foil with little or! ho 

deflection. v 

Surrounding the positive nucleus of- y typical 
atpfti is a cloud of negative charge mad6 up of planetary 
electrons. Each ., , • thes6 electrons contains one 
U|Sit of negative electricity equal in amount to the unit 
' ' ' positive electricity contained in the proton v 
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In the normal atom, the number of electrons 
, this cloud is exactly equal to the number of protons in th$ 
nucleus. The charge pf a normal atom is thesre-. 

for6 snero/ since the equal and opposite effects ■ • 
the positive and negative charges balance one another. 

If an external force is applied an atom* one 

or more of the outermost electrons may be removed. This is 
■ ' ■ . . : " because the outer elections ar^ not attrapted 
as strongly tp the positive nuoleus as / the inhdr 

eleotrons..'. ■ ' . : -.:-^/ . 

When atoms combine to form an element^-^^ substance , thd ■ 
oiiter electrons one atom will interact vith the 

outer electrons Of neighboring atoms to form bonds 
tho atoms. These atomic bonds constitute the binding force 
which holds all matter together. , ' ' . bonding oOcurs 
in some svUbstances# each atom retains its full con^lement 
of electrons, in substances r. one P^ »pre outer 

eleotrchs will be gained pjr iPSt fis- a result • ' ' ' 
bpnding. As indicated by the above statements . , tJt^ eieptrpn 
.bonfiguratipn pf the atom is ^ _ great impoKtiincd . 

The chemical and electrical prop^rtie^ of , a matf>l:ial ^ife 
almost wholly dependent ; .- the electron .a^?fa|>gement 

^^v^r/;;^'^: VithiA its /atpms* :; ' ^ ^ .;■ \. •. / '; 

M As mights b^^^ the nucleus is '- ' ■ . 

shielded by thP electron cloud and does not enter intp 
' ohemiPal or electrical processes. ; '-..-i - (JieJfUpt the 
nuoleus of an atom requires a vast amount of energy such 
«e released by each atom in the explosion of 

an atomip bomb. 

. The total energy , by the electron (kinetid 

plus pptential) is the factor which determines the radivw 
of electron orbit, In ordetr for tbe ^Uctron 

to remain in' this prbit it must _ ■ ' , ' gain nor Ipsp 
energy. , 

Light energy exists in tiny packets or bundles of 
energy photons. Each photon contains a definite 

amount of energy depending on the color (wavelength) 

- light it represents. Should a photon of suffi- 

oient energy collide with' the orbital hydrpgeh . # 

the electron will absorb th6 photoris energy. Th^ electron 

: which how has a greater >. normal amount of energy. 

will jump to a new orbit fartheV' from the nuoleus. 

first hew orbit to which the electrpn can jump 

has. a radius fovir times large as. the radius of 

n ' the original orbit* '. . . 



Had the electron received a greater. , 
energy, the next possible orbit to which it could jump 

would have a ^ nine times the original. Thus, 

each orbit itiay be corTsIdered to represent one of ^. ... 

large number of energy levels that the electron may attain. 
It must be emphasized _ the electron cannot jump 

to just any ORBIT. The electron will remain in Its , 
orbit until a sufficient amount of energy is available, at 
which time the electron _ accept the energy and 

jump to one of a series of PERMISSIBLE orbits . An ■ 

cannot exist in the space between permissible orbits or 

energy levels. This indicates that ^electron 

will not accept a photon of energy unless it contains 
enough energy to ' the electron to one of the 

allowed energy levels. Heat energy and collisions with 
particles can also cause the electron to jump 

orbits. 

Once the electron has been to any energy 

level higher than the lowest possible energy level, the atom 
is to be in an EXCITED state. 



The electron will not remain in this excited ^ ^. 

^or more than a fraction of a second before it will radiate 
the excess . and return to a lower energy orbit. 

To illustrate this principle assume that a ^ , eleor 
tron has just received a photon of energy sufficient to 
raise -it from the . . to the third energy lever. In 

a short period of time the electron may back 
the first level emitting a new photon identical to the one 
it ■ 

A second alternative wo\ild be for the electron to 
return to the lower level , two jumpa; from Jihe 
third to the second, an<i>hftn from lAe second to 
first. In this case the electron would emit two J^notons, 
one for each jump. , Of these photons would have 

less energy than the original photon which excited the 

and would represent a longer wavelength of light, 

This principle is used in the light wher^ 

Ultraviolet light photons, which are not visible to the 
human eye, 'bombard - ' ' ; ■ . - phosphor coating on the inside 
of a glass tube. The phosphor electroi^s in returning 

_ their normal orbits emit photons, of light that 
are of a visible wavelength (longer ) « By using 

the proper chemicals for the phosphor coating any color of 
light may ' used in lighting up the sci*6en of a 

television picture tubei 



Although hydrogfen has simplest of all atoms / 

the basic principles just developed apply e<3ually well to 
the of more complex elements. The manjier in 

w^ioH tJ^e orbits are established in an corttaii[iiflg 



more than one electron. ia somewhat complicatert and- is part 

of a science as quantum mechanica. in an atom 

containing two or more electrons, the electrons interact 

each other and the exact path of any one eleo- 

tron is very difficult to ' ' .^ .■,» However, each elec- 

tron will lie in a specific energy band and the above 
mentioned will be considered as an average of 

the electrons positions. 

The* difference between the . * insofar as 

their chemical activity and stability is concerned, is 
dependent upon the number - position of the^par- 

ticles included within the atom. Atoms range from the 
simplest, the atom containing one proton and 

one electron, to the very complex atomic structures such 

. silver containing forty-seven protons and forty- 

seven electrons. How then are these electrons positiotted 
within atom^ In general, the electrons reside 

in groups o£ orbits called shells. These shells^,, ' . 
olliptically shaped and are assumed to be located a<; fixed 
intervals as predicted bv _ Bohr concept* Thus, 

the shells and the number of electrons required to fill ^ 

■ be predicted. The second shell fo^t example, 

would contain ^ e lectrone when f ull . in to beihg 

numbered, the shells are also given letter designations . . 
Starting with the she 1 1 to the liuoleus 4nd pro* 

gressing outward, the shells are labeled K, L, ■ : ' ^ 

P, and Q respectively. ' . 

The shells are considered to be full or complete when 
. , contain the following quantities of electrons, v 
Two in the K shell, eight in the shell, eight;een 

in the M shell, and so in accordancd with the exclusion; 
principle. the N shell, the actual number of 

electrons, required to fill a shell has • been experi 

mentally determined. 

Progressing away from the atomic nucleus, the first . 
electron shell which ■ .. ■ _ not have the full comple- 
ment of electrons in that shell is called. the VALENCE- 
- Even though the inert elements (helium, 

neon, argon, jcrypton, xenon and radon) have a . ' » 

complement of electrons In all shells, the outer shell of 
these elements is still ' - ' the VALENCE $HELL. The 

stability of an atom is greatest when the valence shell 
: ■ an atom is occupied by the full quota of allow-. 

able electrons. Hence, the element has mini'* 

mum stability while neon has maximum. stability. 
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Electronics and electron theory is very 

recent science compared to chemical science • rKe^term 
VALENCE was used as a ______ of the standard chemical 

vocabulary long before the electron concept was evolved. 

When the theory was firmly established, the 

new term ELECTROVALENCE was officially adopted; the two 
terms . be used interchangeably. 

The capacity of one element to combine with another 
element is . . by the number of electrons which an 

atom donates, or accepts, or shares with _ _ atom 
to secure a complete valence 'shell, and is called ELECTRO- 
VALENCE. 

The valence of _________ atom is expressed in terms 

of a number, prefixed by a + or sign, indicating 

how many electrons the atom gains or loses during a chemi- 
cal reaction, indicating the number of electron- 
pairs shared during the change. Generally, if the atom has 

. than half of the eight electrons to complete 

Its valence shell, it will tend . complete its 
shell by removing electrons from the valence shell of some 

other atom the process of forming a compound. 

The atoms gaining electrons are prefixed by a ^ 
(-) sign. It is also generally true that if an atom has 
half of . valence shell filled, the atom may 

act in either direction; that is it may . its 
valence electrons to one type of atom, but when combined 
with some other _ , ' remove electrons from 

the other atom to fill its own valence shell. 

_._ valence numbers are prefixed with either a 

+ or - sign depending upon the reaction which 

taUces place • If the element has less than half of its 

required electrons, it will usually donate its 

electrons to some other atom during the process! 
forming a compound; and their valence number is prefixed 
by a plus (+) . , 

Previous discussions have shown that atoms possessing 

more than half of their valence electrons ^ tend 

to fill their valence shells at the expense of other atoms* 

Those atoms ^ do not possess half of the electrons 

required to fill the valence shell generally . 

their valence electrons to other atoms. When chemical 

bonding is accomplished by an exchange electrons 

between atoms, the atoms are said to be held together in an 
IONIC , 

Many atoms react chemically to form a compound with- 
out donating or accepting electrons; the atoms 

share the electrons they have in common. The sharing of 

valence electrons between is known as electron-- 

pair or COVALENT bonding. : 
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It was mentioned previously that ions 

.and that they are atoms that have assumed & jharge. It 

was stated that are positive and negative ions. 

The process whereby an atom acquires a charge will ^ 

discussed at this time* 

It is possible to drive one or more electrons out 
- any of the shelly surrounding the nucleus* In 

the case of incomplete shells r it also possible 

to cause one or more additional electrons to become 

attached to the • In either case, whether the 

atom loses electrons or gains electrons, it is said 

be IONIZED* For ionization to take place there 

must be a transfer of energy results in a change 

in the internal energy of the atom. 

Thus, ionization is process by which an 

atom loses or gains electrons. 

An atom having more than normal amount of 

electrons acquires a negative charge, and called 

a NEGATIVE ION. 

. atom that gives up some of its normal elec- 

trons is left with less negative [ than positive 

charges and is called a POSITIVE ION. 

In the study of electronics, . association of 

matter and electricity is of paramount importance. Since 

every electronic device is of parts made from 

ordinary matter, the effects of electricity on matter must 

be understood. As a means of accomplishing 

this, all the elements of which matter is may 

be placed into one of three categories: CONDUCTORS, SEMI- 
CONDUCTORS, AND INSULATORS. Conductors for , are 

elements such as copper and silver which will conduct a 

flow of electricity ■ readily. Due to their good 

conducting abilities they are formed into wire and used 

it is desired to transfer electrical energy from 

one point to another. Insulators (non-conductors) 

the other hand, do not conduct electricity to any great 
degree and are therefore when it is desirable 

to prevent a flow of electricity. Elements and compounds 
such sulpher, rubber, and glass are good insu- 

lator^^ Materials such as germanium and silicon are 

goojd conductors, but cannot be used as insula- 
tors either, since their electrical characteristics fall 
those of conductors and insulators. These in- 
between materials which do not make good conductors 
good insulators are classified as semi-conductors. 

It was previously mentioned that by the process 

^ ionization, electrons could be removed from the 

-•nfluence of the parent atom. These electrons, 
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removed from the atom, are capable of moving through the 

material under the influence ^ ^ external forces* 

It is by virtue of the movement of tnese electrons that 
electrical is transported from place to place • 

The ability of a material such as copper 

conduct electricity must therefore depend on the number of 

dislodged electrons normally available within ^ 

material « Since copper is a good conductor , it must contain 
vast numbers of dislodged FREE electrons • 

To understand how the electrons become free, it is 

necessary to refer to the electron energy levels 

within the atom. It was previously stated that if 



the right amount of energy was added to an orbital electron ^ 

it would jump a new orbit located farther from 

the nucleus • If the energy is sufficiently large/ 



jump may carry the electron to such a distance from the 
positive nucleus that \ electron becomes free* 

Once free, the electron constitutes the charge carrier 

discussed above* The ^ problem remaining is to 

determine how the electron in the piece of copper obtains 
^ energy to become free* 

After a moments consideration a person realizes that 

the average ^ of copper contains some sunount of 

heat energy. In fact, a piece of copper room 

temperature (72^ p) is approximately 531op above ab^solute 
zerol This temperature indicates that the , al- 

though only warm to the touch/ must contain a consT3erable 
amount of heat energy* phonons of heat energy ^ 

along with other forms oi natural radiation/ elevate the 
electrons ^_ the energy levels where they can be- 
come free* 

From the preceeding theories / one might 



why all materials containing the same amount of heat energy 

do not conduct electricity well* The answer lies 

in the fact that the electrons in various materials require 

. amounts of energy to become free. The outer shell 

has two energy bands called VALENCE BAND and the 

CONDUCTION BAND. Between these two energy bands is an 
energy called the forbidden gap or forbidden band. 

Electrons residing in the valence band are 
BOUND ELECTRONS. They ace considered to be firmly attached 

to the parent atoms and not available for the 

conduction of electricity. 

In order for an electron to become free 

electron/ it must gain enough energy from external forces 
to jump the forbidden and appear in the conduc- 
tion band. 
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Once in the conduction band/ the electron is 
and may be made to move along through the conductor in the 
form of electric current. 



Insulators have a very wide energy gap. This means 

that' a large of energy must be added to each 

electron in an insulating material before it 

becomei free. Thus^ at room temperature sufficient energy 

is not available to cause electrons ^ jump to 

the conduction band and the material has practically no 
free electrons. 

The has little or no forbidden gap. Since 

this is true, unaer normal conditions the band 

for a conductor contains a sufficient number of electrons 
to make it a conductor of electricity. 

The semi-conductor being neither a good conductor 

or a good insulator an energy gap between that 

of a conductor and that of an insulator. 
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